[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:30:37 dist-test-slave-9jjr krb5kdc[23718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:30:37 dist-test-slave-9jjr krb5kdc[23718](info): set up 2 sockets
Aug 11 01:30:37 dist-test-slave-9jjr krb5kdc[23718](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 01:30:38.080035 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:30:38 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:30:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:30:38.293905 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36001
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36001
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:38.654035 23735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:38.654469 23735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:38.654645 23735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:38.665647 23735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:30:38.665771 23735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:38.665858 23735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:38.665977 23735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:30:38.666062 23735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:30:38.676482 23735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36001
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:38.677896 23735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:38.679335 23735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:38.692040 23740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:38.691967 23741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:38.692088 23743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:38.692895 23735 server_base.cc:1034] running on GCE node
I20260811 01:30:38.693706 23735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:38.695326 23735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:38.696566 23735 hybrid_clock.cc:648] HybridClock initialized: now 1786411838696524 us; error 80 us; skew 500 ppm
I20260811 01:30:38.696902 23735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:38 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411838, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:38.700390 23735 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:30:38.702009 23735 webserver.cc:460] Webserver started at http://127.23.39.254:34729/ using document root <none> and password file <none>
I20260811 01:30:38.702769 23735 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:38.702903 23735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:38.703249 23735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:38.706564 23735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "fba5f215f09d49f3a1c1259f98875038"
format_stamp: "Formatted at 2026-08-11 01:30:38 on dist-test-slave-9jjr"
server_key: "44614d64bfd6b51344fe9775013fd8d2"
server_key_iv: "dad4cbb90a7a505d21556f18291808b8"
server_key_version: "encryptionkey@0"
I20260811 01:30:38.707377 23735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "fba5f215f09d49f3a1c1259f98875038"
format_stamp: "Formatted at 2026-08-11 01:30:38 on dist-test-slave-9jjr"
server_key: "44614d64bfd6b51344fe9775013fd8d2"
server_key_iv: "dad4cbb90a7a505d21556f18291808b8"
server_key_version: "encryptionkey@0"
I20260811 01:30:38.713099 23735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:30:38.717206 23750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:38.718850 23735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:30:38.719058 23735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "fba5f215f09d49f3a1c1259f98875038"
format_stamp: "Formatted at 2026-08-11 01:30:38 on dist-test-slave-9jjr"
server_key: "44614d64bfd6b51344fe9775013fd8d2"
server_key_iv: "dad4cbb90a7a505d21556f18291808b8"
server_key_version: "encryptionkey@0"
I20260811 01:30:38.719291 23735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:38.742782 23735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:38.748126 23735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:38.748514 23735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:38.769856 23735 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:36001
I20260811 01:30:38.769902 23808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:36001 every 8 connection(s)
I20260811 01:30:38.771384 23735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:30:38.775641 23809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:38.776988 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 23735
I20260811 01:30:38.777344 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:30:38.779892 23711 external_mini_cluster.cc:1428] Setting key 6e4b674e95fc9f396ed4bd5f2b15f2f8
I20260811 01:30:38.789297 23809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038: Bootstrap starting.
I20260811 01:30:38.792416 23809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:38.793498 23809 log.cc:824] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:38.796839 23809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038: No bootstrap required, opened a new log
I20260811 01:30:38.807535 23809 raft_consensus.cc:348] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } }
I20260811 01:30:38.808125 23809 raft_consensus.cc:374] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:38.808267 23809 raft_consensus.cc:729] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba5f215f09d49f3a1c1259f98875038, State: Initialized, Role: FOLLOWER
I20260811 01:30:38.809078 23809 consensus_queue.cc:260] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } }
I20260811 01:30:38.809458 23809 raft_consensus.cc:388] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:30:38.809623 23809 raft_consensus.cc:482] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:30:38.809849 23809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 01:30:38 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:38.813442 23809 raft_consensus.cc:504] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } }
I20260811 01:30:38.814028 23809 leader_election.cc:302] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fba5f215f09d49f3a1c1259f98875038; no voters:
I20260811 01:30:38.814745 23809 leader_election.cc:288] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:30:38.815037 23815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:38.817384 23815 raft_consensus.cc:686] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [term 1 LEADER]: Becoming Leader. State: Replica: fba5f215f09d49f3a1c1259f98875038, State: Running, Role: LEADER
I20260811 01:30:38.817927 23809 sys_catalog.cc:564] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:30:38.818197 23815 consensus_queue.cc:237] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } }
I20260811 01:30:38.823827 23818 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fba5f215f09d49f3a1c1259f98875038. Latest consensus state: current_term: 1 leader_uuid: "fba5f215f09d49f3a1c1259f98875038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } } }
I20260811 01:30:38.824297 23818 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:38.826462 23817 sys_catalog.cc:455] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fba5f215f09d49f3a1c1259f98875038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fba5f215f09d49f3a1c1259f98875038" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36001 } } }
I20260811 01:30:38.827018 23817 sys_catalog.cc:458] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038 [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:38.832773 23811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:38.784917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.23.39.254:36001)
0811 01:30:38.785903 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:38.785926 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:38.787459 (+ 1533us) server_negotiation.cc:407] Connection header received
0811 01:30:38.796782 (+ 9323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:38.796804 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:38.797263 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:38.797608 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:38.801950 (+ 4342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:38.803527 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:38.806096 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:38.806928 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:38.807083 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:38.815132 (+ 8049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:38.815147 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:38.815169 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:38.815278 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:38.821268 (+ 5990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:38.822933 (+ 1665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:38.822943 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:38.822953 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:38.823251 (+ 298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:38.824163 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:38.824169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:38.824171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:38.826187 (+ 2016us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:38.829846 (+ 3659us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:38.830272 (+ 426us) server_negotiation.cc:299] Negotiation successful
0811 01:30:38.830877 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":461,"threads_started":1}
I20260811 01:30:38.840220 23824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:30:38.846393 23824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:30:38.856464 23824 catalog_manager.cc:1347] Generated new cluster ID: 6d9ee3ac1b614c049b4858b804a4886b
I20260811 01:30:38.856617 23824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:30:38.866875 23824 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:30:38.868942 23824 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:30:38.880635 23824 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fba5f215f09d49f3a1c1259f98875038: Generated new TSK 0
I20260811 01:30:38.881603 23824 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:30:38.940371 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:39.329447 23838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:39.329775 23838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:39.329959 23838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:39.337661 23838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:39.337796 23838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:39.338012 23838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:30:39.348992 23838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:39.350612 23838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:39.352053 23838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:39.366499 23848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:39.366518 23846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:39.366720 23844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:39.367460 23838 server_base.cc:1034] running on GCE node
I20260811 01:30:39.368189 23838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:39.370242 23838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:39.371526 23838 hybrid_clock.cc:648] HybridClock initialized: now 1786411839371470 us; error 48 us; skew 500 ppm
I20260811 01:30:39.371937 23838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:39 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411839, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:39.375582 23838 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:30:39.377163 23838 webserver.cc:460] Webserver started at http://127.23.39.193:39993/ using document root <none> and password file <none>
I20260811 01:30:39.377846 23838 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:39.377954 23838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:39.378345 23838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:39.381431 23838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "7815d36bb2864decabc90ee13111ef88"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "c9c7473cc8346974468b24204ac14263"
server_key_iv: "98b52ac853cfc316620d6afc9ed238ce"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.382319 23838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "7815d36bb2864decabc90ee13111ef88"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "c9c7473cc8346974468b24204ac14263"
server_key_iv: "98b52ac853cfc316620d6afc9ed238ce"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.387876 23838 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:30:39.391722 23855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:39.393323 23838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:30:39.393545 23838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "7815d36bb2864decabc90ee13111ef88"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "c9c7473cc8346974468b24204ac14263"
server_key_iv: "98b52ac853cfc316620d6afc9ed238ce"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.393800 23838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:39.408034 23838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:39.412417 23838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:39.412756 23838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:39.413839 23838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:39.415400 23838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:39.415512 23838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:39.415668 23838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:39.415750 23838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:39.455377 23838 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:43505
I20260811 01:30:39.455478 23980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:43505 every 8 connection(s)
I20260811 01:30:39.456902 23838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:30:39.463563 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 23838
I20260811 01:30:39.463835 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:30:39.464510 23711 external_mini_cluster.cc:1428] Setting key e3ed6d16e21e435e6ca10e0a60eb6849
Aug 11 01:30:39 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411839, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:39.480597 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:39.460151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:53653 (local address 127.23.39.254:36001)
0811 01:30:39.460735 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:39.460740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:39.462054 (+ 1314us) server_negotiation.cc:407] Connection header received
0811 01:30:39.464301 (+ 2247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:39.464308 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:39.464425 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:39.464553 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:39.466557 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:39.467313 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:39.469002 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:39.469406 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:39.469558 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:39.473767 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:39.473772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:39.473776 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:39.473810 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:39.476671 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:39.477849 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:39.477854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:39.477856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:39.477989 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:39.478569 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:39.478572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:39.478574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:39.478903 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:39.479021 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:39.480104 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0811 01:30:39.480313 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":321,"threads_started":1}
I20260811 01:30:39.482366 23986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:39.460931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36001 (local address 127.23.39.193:53653)
0811 01:30:39.461830 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:39.461878 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:39.463955 (+ 2077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:39.464827 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:39.464836 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:39.465606 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:39.466358 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:39.466380 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:39.467507 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:39.467511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:39.468829 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:39.468841 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:39.469670 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:39.469680 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:39.469939 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:39.470763 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:39.470788 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:39.473420 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:39.476868 (+ 3448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:39.476881 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:39.476904 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:39.477697 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:39.478107 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:39.478115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:39.478153 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:39.478439 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:39.479044 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:39.479056 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:39.479652 (+ 596us) client_negotiation.cc:769] Sending connection context
0811 01:30:39.479979 (+ 327us) client_negotiation.cc:240] Negotiation successful
0811 01:30:39.480655 (+ 676us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":350,"threads_started":1}
I20260811 01:30:39.484233 23981 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36001
I20260811 01:30:39.484632 23981 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:39.485456 23981 heartbeater.cc:511] Master 127.23.39.254:36001 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
I20260811 01:30:39.488044 23768 ts_manager.cc:194] Registered new tserver with Master: 7815d36bb2864decabc90ee13111ef88 (127.23.39.193:43505)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
I20260811 01:30:39.489740 23768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:53653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:30:39.517624 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:39.885736 23990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:39.886137 23990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:39.886368 23990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:39.894222 23990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:39.894407 23990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:39.894593 23990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:30:39.905273 23990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:39.906832 23990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:39.908290 23990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:39.922616 23996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:39.922658 23997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:39.922716 23999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:39.923882 23990 server_base.cc:1034] running on GCE node
I20260811 01:30:39.924608 23990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:39.925575 23990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:39.926822 23990 hybrid_clock.cc:648] HybridClock initialized: now 1786411839926740 us; error 61 us; skew 500 ppm
I20260811 01:30:39.927203 23990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:39 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411839, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:39.935870 23990 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:30:39.937676 23990 webserver.cc:460] Webserver started at http://127.23.39.194:37893/ using document root <none> and password file <none>
I20260811 01:30:39.938495 23990 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:39.938613 23990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:39.938951 23990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:39.942576 23990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "5075160ff31a48ea8d83c4f5b3d7a1a5"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "0c92bd727c52db25e37007d8dad0e987"
server_key_iv: "ee668d8e5329936325488ad82a6bcc96"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.943420 23990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "5075160ff31a48ea8d83c4f5b3d7a1a5"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "0c92bd727c52db25e37007d8dad0e987"
server_key_iv: "ee668d8e5329936325488ad82a6bcc96"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.949249 23990 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:30:39.953158 24006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:39.954806 23990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:30:39.955010 23990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "5075160ff31a48ea8d83c4f5b3d7a1a5"
format_stamp: "Formatted at 2026-08-11 01:30:39 on dist-test-slave-9jjr"
server_key: "0c92bd727c52db25e37007d8dad0e987"
server_key_iv: "ee668d8e5329936325488ad82a6bcc96"
server_key_version: "encryptionkey@0"
I20260811 01:30:39.955314 23990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:39.972744 23990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:39.977746 23990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:39.978072 23990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:39.979267 23990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:39.981017 23990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:39.981132 23990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:39.981278 23990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:39.981366 23990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:40.020562 23990 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:40579
I20260811 01:30:40.020740 24128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:40579 every 8 connection(s)
I20260811 01:30:40.021955 23990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:30:40.031090 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 23990
I20260811 01:30:40.031360 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:30:40.031804 23711 external_mini_cluster.cc:1428] Setting key 26b897585678f10fc95a2df2f0fac3ad
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411839, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:40.043779 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.024820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:58495 (local address 127.23.39.254:36001)
0811 01:30:40.025319 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.025324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.026357 (+ 1033us) server_negotiation.cc:407] Connection header received
0811 01:30:40.028303 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.028309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.028404 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.028526 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.030240 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.030974 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.032828 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.033500 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.033638 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.037411 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.037416 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.037419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.037453 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.040400 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.041260 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.041264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.041267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.041398 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.041876 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.041880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.041882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.042235 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.042395 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.043150 (+ 755us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.043395 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":275,"threads_started":1}
I20260811 01:30:40.044831 24132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.025342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36001 (local address 127.23.39.194:58495)
0811 01:30:40.026170 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:40.026231 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:40.028008 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:40.028799 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:40.028808 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:40.029389 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:40.030010 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:40.030030 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.031161 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.031165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:40.032661 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:40.032677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.033805 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.033820 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:40.034042 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.034834 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:40.034857 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:40.037144 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:40.040544 (+ 3400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:40.040554 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:40.040572 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:40.041113 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:40.041519 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:40.041524 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:40.041528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:40.041743 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:40.042369 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:40.042377 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:40.042748 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 01:30:40.043030 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 01:30:40.043620 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":319,"threads_started":1}
I20260811 01:30:40.046495 24129 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36001
I20260811 01:30:40.046854 24129 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:40.047887 24129 heartbeater.cc:511] Master 127.23.39.254:36001 requested a full tablet report, sending...
I20260811 01:30:40.049791 23768 ts_manager.cc:194] Registered new tserver with Master: 5075160ff31a48ea8d83c4f5b3d7a1a5 (127.23.39.194:40579)
I20260811 01:30:40.051126 23768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:58495
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:30:40.082060 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:40.441147 24137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:40.441457 24137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:40.441579 24137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:40.449487 24137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:40.449625 24137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:40.449751 24137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:30:40.460696 24137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36001
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:40.462044 24137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:40.463467 24137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:40.477607 24142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:40.477550 24145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:40.477552 24143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:40.478550 24137 server_base.cc:1034] running on GCE node
I20260811 01:30:40.479206 24137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:40.480294 24137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:40.481565 24137 hybrid_clock.cc:648] HybridClock initialized: now 1786411840481497 us; error 64 us; skew 500 ppm
I20260811 01:30:40.482007 24137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:40.485630 24137 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:30:40.487495 24137 webserver.cc:460] Webserver started at http://127.23.39.195:35671/ using document root <none> and password file <none>
I20260811 01:30:40.488335 24137 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:40.488507 24137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:40.488871 24137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:40.492316 24137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "7b19a5c1b27d4834a248090999b8356c"
format_stamp: "Formatted at 2026-08-11 01:30:40 on dist-test-slave-9jjr"
server_key: "ada85f7a5d60f27b8a67c3b4a5f1ed73"
server_key_iv: "5c7310088efeb1132176de5a6f9550df"
server_key_version: "encryptionkey@0"
I20260811 01:30:40.493211 24137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "7b19a5c1b27d4834a248090999b8356c"
format_stamp: "Formatted at 2026-08-11 01:30:40 on dist-test-slave-9jjr"
server_key: "ada85f7a5d60f27b8a67c3b4a5f1ed73"
server_key_iv: "5c7310088efeb1132176de5a6f9550df"
server_key_version: "encryptionkey@0"
I20260811 01:30:40.494302 23981 heartbeater.cc:503] Master 127.23.39.254:36001 was elected leader, sending a full tablet report...
I20260811 01:30:40.499953 24137 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.008s
I20260811 01:30:40.504034 24153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:40.505774 24137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 01:30:40.505986 24137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "7b19a5c1b27d4834a248090999b8356c"
format_stamp: "Formatted at 2026-08-11 01:30:40 on dist-test-slave-9jjr"
server_key: "ada85f7a5d60f27b8a67c3b4a5f1ed73"
server_key_iv: "5c7310088efeb1132176de5a6f9550df"
server_key_version: "encryptionkey@0"
I20260811 01:30:40.506280 24137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:40.538789 24137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:40.543509 24137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:40.543830 24137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:40.545007 24137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:40.546715 24137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:40.546794 24137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:40.546959 24137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:40.547039 24137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:40.585075 24137 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46469
I20260811 01:30:40.585172 24279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46469 every 8 connection(s)
I20260811 01:30:40.586614 24137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:30:40.594398 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24137
I20260811 01:30:40.594626 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:30:40.595099 23711 external_mini_cluster.cc:1428] Setting key 87827550774ad851a04de99e8fdbc759
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:40.609743 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.589607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:49265 (local address 127.23.39.254:36001)
0811 01:30:40.590173 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.590186 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.591276 (+ 1090us) server_negotiation.cc:407] Connection header received
0811 01:30:40.593336 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.593343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.593441 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.593570 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.595595 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.596711 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.599225 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.599656 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.599809 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.603753 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.603758 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.603761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.603797 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.606471 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.607320 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.607325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.607328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.607476 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.607930 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.607933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.607936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.608225 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.608354 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.609151 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.609378 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":256,"threads_started":1}
I20260811 01:30:40.610992 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.590279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36001 (local address 127.23.39.195:49265)
0811 01:30:40.591080 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:40.591127 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:40.592994 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:40.593885 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:40.593895 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:40.594624 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:40.595398 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:40.595419 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.596882 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.596886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:40.599068 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:40.599081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.599928 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.599936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:40.600197 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.600874 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:40.600899 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:40.603458 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:40.606635 (+ 3177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:40.606643 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:40.606660 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:40.607163 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:40.607581 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:40.607585 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:40.607587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:40.607824 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:40.608344 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:40.608350 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:40.608714 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 01:30:40.608970 (+ 256us) client_negotiation.cc:240] Negotiation successful
0811 01:30:40.609417 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":340,"threads_started":1}
I20260811 01:30:40.612785 24280 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36001
I20260811 01:30:40.613168 24280 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:40.614053 24280 heartbeater.cc:511] Master 127.23.39.254:36001 requested a full tablet report, sending...
I20260811 01:30:40.615849 23767 ts_manager.cc:194] Registered new tserver with Master: 7b19a5c1b27d4834a248090999b8356c (127.23.39.195:46469)
I20260811 01:30:40.616852 23767 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:49265
I20260811 01:30:40.625492 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:40.686478 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.668859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34634 (local address 127.23.39.193:43505)
0811 01:30:40.669638 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.669648 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.669683 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:30:40.669889 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.669899 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.670201 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.670410 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.672062 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.673095 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.674560 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.675183 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.675356 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.680035 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.680053 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.680070 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.680121 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.683427 (+ 3306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.684244 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.684253 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.684255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.684396 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.684788 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.684791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.684793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.685237 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.685482 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.685747 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.685969 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":392,"threads_started":1}
W20260811 01:30:40.687857 23886 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34634
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:40.743976 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.728177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34640 (local address 127.23.39.193:43505)
0811 01:30:40.728435 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.728443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.728634 (+ 191us) server_negotiation.cc:407] Connection header received
0811 01:30:40.728804 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.728809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.728881 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.728974 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.731013 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.731752 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.733040 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.733502 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.733602 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.738328 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.738334 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.738337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.738383 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.741375 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.742209 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.742213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.742215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.742388 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.742760 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.742763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.742765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.743033 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.743255 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.743537 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.743722 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 01:30:40.745647 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 23838
I20260811 01:30:40.760192 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.746792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.23.39.193:43505)
0811 01:30:40.746984 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.746988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.747446 (+ 458us) server_negotiation.cc:407] Connection header received
0811 01:30:40.747595 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.747599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.747658 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.747738 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.749059 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.749774 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.751220 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.751675 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.751774 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.754282 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.754287 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.754291 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.754331 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.757204 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.757921 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.757925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.757927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.758097 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.758609 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.758612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.758614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.758909 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.759102 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.759541 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.759747 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:30:40.761138 23976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:40.849289 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 23838
I20260811 01:30:40.870975 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 23990
Aug 11 01:30:40 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:30:40.888693 24296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:40.872040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35914 (local address 127.23.39.194:40579)
0811 01:30:40.872640 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:40.872648 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:40.872675 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:30:40.872738 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:40.872744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:40.872958 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:40.873095 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:40.874522 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.875748 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.877071 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:40.877704 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:40.877816 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:40.882493 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:40.882510 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:40.882526 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:40.882576 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:40.885627 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.886496 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.886505 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.886507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.886654 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:40.887168 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:40.887172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:40.887174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:40.887605 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:40.887934 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:40.888162 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:30:40.888390 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":319,"threads_started":1}
I20260811 01:30:40.890102 24124 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:40.978263 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 23990
I20260811 01:30:40.999449 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24137
Aug 11 01:30:41 dist-test-slave-9jjr krb5kdc[23718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:30:41.017129 24298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:41.000549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37106 (local address 127.23.39.195:46469)
0811 01:30:41.001235 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:41.001242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:41.001273 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:30:41.001339 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:41.001345 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:41.001563 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:41.001702 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:41.003143 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:41.004271 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:41.005598 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:41.006252 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:41.006361 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:41.011066 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:41.011078 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:41.011091 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:41.011131 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:41.014365 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:41.015119 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:41.015126 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:41.015129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:41.015257 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:41.015660 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:41.015663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:41.015665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:41.016035 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:41.016269 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:41.016614 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:30:41.016833 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":368,"threads_started":1}
I20260811 01:30:41.018600 24275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:41.105080 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24137
I20260811 01:30:41.127096 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 23735
I20260811 01:30:41.128474 23803 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:41.234754 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 23735
2026-08-11T01:30:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4341 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:30:41 dist-test-slave-9jjr krb5kdc[24303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:30:41 dist-test-slave-9jjr krb5kdc[24303](info): set up 2 sockets
Aug 11 01:30:41 dist-test-slave-9jjr krb5kdc[24303](info): commencing operation
krb5kdc: starting...
W20260811 01:30:42.390957 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:30:42 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:30:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:30:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:30:42.614032 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33421
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:33421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:42.966391 24317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:42.966765 24317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:42.966943 24317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:42.974910 24317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:30:42.975075 24317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:42.975194 24317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:42.975302 24317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:30:42.975383 24317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:30:42.986286 24317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:33421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:42.987803 24317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:42.989280 24317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:43.001876 24323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:43.001782 24326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:43.002065 24324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:43.002856 24317 server_base.cc:1034] running on GCE node
I20260811 01:30:43.003786 24317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:43.005295 24317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:43.006537 24317 hybrid_clock.cc:648] HybridClock initialized: now 1786411843006490 us; error 33 us; skew 500 ppm
I20260811 01:30:43.006919 24317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:43 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411843, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:43.010386 24317 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:30:43.012152 24317 webserver.cc:460] Webserver started at http://127.23.39.254:40685/ using document root <none> and password file <none>
I20260811 01:30:43.012903 24317 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:43.013069 24317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:43.013425 24317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:43.016826 24317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "d17457ae211f48f69417cecec260e669"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "02d89db5a3f75f8b7ffc8f9657c10ccb"
server_key_iv: "4d2692a41ff7a4d6ee3552234e24e0be"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.017696 24317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "d17457ae211f48f69417cecec260e669"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "02d89db5a3f75f8b7ffc8f9657c10ccb"
server_key_iv: "4d2692a41ff7a4d6ee3552234e24e0be"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.023639 24317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 01:30:43.027603 24333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:43.029032 24317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 01:30:43.029274 24317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "d17457ae211f48f69417cecec260e669"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "02d89db5a3f75f8b7ffc8f9657c10ccb"
server_key_iv: "4d2692a41ff7a4d6ee3552234e24e0be"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.029512 24317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:43.042383 24317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:43.046561 24317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:43.046865 24317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:43.066259 24317 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:33421
I20260811 01:30:43.066282 24394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:33421 every 8 connection(s)
I20260811 01:30:43.067842 24317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:30:43.071754 24395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:43.077195 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24317
I20260811 01:30:43.077455 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:30:43.078194 23711 external_mini_cluster.cc:1428] Setting key 28f2b79f89dd75a155d6a5bc7deb26e1
I20260811 01:30:43.084430 24395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: Bootstrap starting.
I20260811 01:30:43.088398 24395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:43.089582 24395 log.cc:824] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:43.092854 24395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: No bootstrap required, opened a new log
Aug 11 01:30:43 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:43.103138 24395 raft_consensus.cc:348] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } }
I20260811 01:30:43.103623 24395 raft_consensus.cc:374] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:43.103754 24395 raft_consensus.cc:729] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d17457ae211f48f69417cecec260e669, State: Initialized, Role: FOLLOWER
I20260811 01:30:43.104405 24395 consensus_queue.cc:260] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } }
I20260811 01:30:43.104656 24395 raft_consensus.cc:388] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:30:43.104815 24395 raft_consensus.cc:482] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:30:43.104856 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:43.080554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53628 (local address 127.23.39.254:33421)
0811 01:30:43.081513 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:43.081529 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:43.081586 (+ 57us) server_negotiation.cc:407] Connection header received
0811 01:30:43.084190 (+ 2604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:43.084220 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:43.084748 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:43.085211 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:43.086685 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.088726 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.090074 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.090980 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.091170 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:43.096025 (+ 4855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:43.096046 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:43.096067 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:43.096120 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:43.099688 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:43.100661 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:43.100668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:43.100676 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:43.100881 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:43.101323 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:43.101327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:43.101329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:43.101976 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:43.102292 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:43.102813 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 01:30:43.103284 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":416,"threads_started":1}
I20260811 01:30:43.105001 24395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:43.107534 24395 raft_consensus.cc:504] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } }
I20260811 01:30:43.108152 24395 leader_election.cc:302] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d17457ae211f48f69417cecec260e669; no voters:
I20260811 01:30:43.108777 24395 leader_election.cc:288] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:30:43.108934 24402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:43.109658 24402 raft_consensus.cc:686] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [term 1 LEADER]: Becoming Leader. State: Replica: d17457ae211f48f69417cecec260e669, State: Running, Role: LEADER
I20260811 01:30:43.110321 24402 consensus_queue.cc:237] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } }
I20260811 01:30:43.111119 24395 sys_catalog.cc:564] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:30:43.113059 24403 sys_catalog.cc:455] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d17457ae211f48f69417cecec260e669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } } }
I20260811 01:30:43.113557 24403 sys_catalog.cc:458] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:43.114360 24404 sys_catalog.cc:455] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d17457ae211f48f69417cecec260e669. Latest consensus state: current_term: 1 leader_uuid: "d17457ae211f48f69417cecec260e669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d17457ae211f48f69417cecec260e669" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33421 } } }
I20260811 01:30:43.114743 24404 sys_catalog.cc:458] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669 [sys.catalog]: This master's current role is: LEADER
W20260811 01:30:43.123133 24418 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:30:43.123255 24418 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:30:43.123401 24410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:30:43.125697 24410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:30:43.135255 24410 catalog_manager.cc:1347] Generated new cluster ID: d9870fae04c0483cad650afb785008f4
I20260811 01:30:43.135385 24410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:30:43.156314 24410 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:30:43.157696 24410 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:30:43.165431 24410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d17457ae211f48f69417cecec260e669: Generated new TSK 0
I20260811 01:30:43.166373 24410 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:30:43.234021 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:43.591267 24423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:43.591593 24423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:43.591696 24423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:43.599563 24423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:43.599707 24423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:43.599833 24423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:30:43.610394 24423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:43.611917 24423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:43.613447 24423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:43.627661 24429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:43.627624 24430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:43.627882 24432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:43.629184 24423 server_base.cc:1034] running on GCE node
I20260811 01:30:43.629932 24423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:43.631045 24423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:43.632516 24423 hybrid_clock.cc:648] HybridClock initialized: now 1786411843632452 us; error 46 us; skew 500 ppm
I20260811 01:30:43.632956 24423 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:43 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411843, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:43.636687 24423 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:30:43.638670 24423 webserver.cc:460] Webserver started at http://127.23.39.193:40153/ using document root <none> and password file <none>
I20260811 01:30:43.639482 24423 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:43.639647 24423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:43.640007 24423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:43.643404 24423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "1979589afcc9458fab2007917b844287"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "5d9d8f4daf5041114c0397312afd0e3b"
server_key_iv: "93e612f4932db6ab2eab64241532db1b"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.644416 24423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "1979589afcc9458fab2007917b844287"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "5d9d8f4daf5041114c0397312afd0e3b"
server_key_iv: "93e612f4932db6ab2eab64241532db1b"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.650461 24423 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 01:30:43.654371 24439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:43.655782 24423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:30:43.655987 24423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "1979589afcc9458fab2007917b844287"
format_stamp: "Formatted at 2026-08-11 01:30:43 on dist-test-slave-9jjr"
server_key: "5d9d8f4daf5041114c0397312afd0e3b"
server_key_iv: "93e612f4932db6ab2eab64241532db1b"
server_key_version: "encryptionkey@0"
I20260811 01:30:43.656231 24423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:43.680825 24423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:43.685525 24423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:43.685860 24423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:43.687005 24423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:43.688504 24423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:43.688616 24423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:43.688781 24423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:43.688856 24423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:43.724834 24423 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33709
I20260811 01:30:43.724900 24563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33709 every 8 connection(s)
I20260811 01:30:43.726397 24423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:30:43.730209 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24423
I20260811 01:30:43.730463 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:30:43.731191 23711 external_mini_cluster.cc:1428] Setting key 77b7a567857a6b3b6629bd1b00d72411
Aug 11 01:30:43 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411843, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:43.752249 24566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:43.729338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:51067 (local address 127.23.39.254:33421)
0811 01:30:43.729833 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:43.729839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:43.731309 (+ 1470us) server_negotiation.cc:407] Connection header received
0811 01:30:43.733699 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:43.733708 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:43.733816 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:43.733971 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:43.735608 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.736787 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.738523 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.739285 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.739441 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:43.744645 (+ 5204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:43.744651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:43.744654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:43.744698 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:43.747825 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:43.749108 (+ 1283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:43.749113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:43.749115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:43.749277 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:43.750000 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:43.750006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:43.750010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:43.750393 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:43.750517 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:43.751751 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0811 01:30:43.751982 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":225,"threads_started":1}
I20260811 01:30:43.753925 24567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:43.730078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33421 (local address 127.23.39.193:51067)
0811 01:30:43.731111 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:43.731164 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:43.733390 (+ 2226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:43.734232 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:43.734241 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:43.734811 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:43.735411 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:43.735430 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.736976 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.736979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:43.738363 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:43.738375 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:43.739586 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:43.739592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:43.739855 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:43.740804 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:43.740842 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:43.744283 (+ 3441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:43.748058 (+ 3775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:43.748071 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:43.748094 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:43.748924 (+ 830us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:43.749485 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:43.749491 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:43.749508 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:43.749811 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:43.750550 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:43.750570 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:43.751155 (+ 585us) client_negotiation.cc:769] Sending connection context
0811 01:30:43.751539 (+ 384us) client_negotiation.cc:240] Negotiation successful
0811 01:30:43.752243 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":439,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
I20260811 01:30:43.755815 24564 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33421
I20260811 01:30:43.756163 24564 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:43.756978 24564 heartbeater.cc:511] Master 127.23.39.254:33421 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
I20260811 01:30:43.759490 24353 ts_manager.cc:194] Registered new tserver with Master: 1979589afcc9458fab2007917b844287 (127.23.39.193:33709)
I20260811 01:30:43.761304 24353 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:51067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:30:43.785593 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:44.189836 24570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:44.190192 24570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:44.190372 24570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:44.197996 24570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:44.198222 24570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:44.198429 24570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:30:44.208909 24570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:44.210431 24570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:44.211905 24570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:44.227732 24575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:44.227712 24576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:44.228643 24578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:44.229512 24570 server_base.cc:1034] running on GCE node
I20260811 01:30:44.230280 24570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:44.231412 24570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:44.232684 24570 hybrid_clock.cc:648] HybridClock initialized: now 1786411844232636 us; error 39 us; skew 500 ppm
I20260811 01:30:44.233094 24570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:44 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411844, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:44.237046 24570 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:30:44.239419 24570 webserver.cc:460] Webserver started at http://127.23.39.194:45001/ using document root <none> and password file <none>
I20260811 01:30:44.240154 24570 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:44.240320 24570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:44.240658 24570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:44.243971 24570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "21a7e51606124a6eabb827e91a29e94d"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "1676ae7d36704cc81741a6d5ea96ba38"
server_key_iv: "54ebcdedb84d609850e080c9ba368b60"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.244854 24570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "21a7e51606124a6eabb827e91a29e94d"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "1676ae7d36704cc81741a6d5ea96ba38"
server_key_iv: "54ebcdedb84d609850e080c9ba368b60"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.251178 24570 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:30:44.255394 24585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.257094 24570 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260811 01:30:44.257301 24570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "21a7e51606124a6eabb827e91a29e94d"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "1676ae7d36704cc81741a6d5ea96ba38"
server_key_iv: "54ebcdedb84d609850e080c9ba368b60"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.257529 24570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:44.299626 24570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:44.304522 24570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:44.304862 24570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:44.305936 24570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:44.307508 24570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:44.307629 24570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.307785 24570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:44.307866 24570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.344273 24570 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35173
I20260811 01:30:44.344331 24705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35173 every 8 connection(s)
I20260811 01:30:44.345713 24570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:30:44.350189 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24570
I20260811 01:30:44.350425 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:30:44.351027 23711 external_mini_cluster.cc:1428] Setting key 3c5c84571c5a66e23d6b8cffc0bc9012
Aug 11 01:30:44 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411844, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:44.372013 24708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.348541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:39549 (local address 127.23.39.254:33421)
0811 01:30:44.349023 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.349028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.350270 (+ 1242us) server_negotiation.cc:407] Connection header received
0811 01:30:44.352788 (+ 2518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.352794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.352880 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.353016 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:44.355284 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.356031 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.358657 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.359074 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.359170 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:44.363754 (+ 4584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:44.363763 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:44.363771 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:44.363824 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:44.367773 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.368890 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.368899 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.368905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.369068 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.369778 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.369787 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.369793 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.370270 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:44.370440 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:44.371193 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 01:30:44.371515 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":233,"threads_started":1}
I20260811 01:30:44.372856 24709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.349177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33421 (local address 127.23.39.194:39549)
0811 01:30:44.350028 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:44.350081 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:44.352490 (+ 2409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:44.353295 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:44.353321 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:44.354111 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:44.355034 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:44.355065 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.356208 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.356216 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:44.358499 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:44.358517 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.359324 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.359334 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:44.359679 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:44.360573 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:44.360610 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:44.363453 (+ 2843us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:44.367979 (+ 4526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:44.367987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:44.368001 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:44.368721 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:44.369239 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:44.369245 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:44.369248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:44.369616 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:44.370412 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:44.370418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:44.370779 (+ 361us) client_negotiation.cc:769] Sending connection context
0811 01:30:44.371020 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 01:30:44.371499 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":293,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
I20260811 01:30:44.374483 24706 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33421
I20260811 01:30:44.374823 24706 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:44.375636 24706 heartbeater.cc:511] Master 127.23.39.254:33421 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
I20260811 01:30:44.377426 24353 ts_manager.cc:194] Registered new tserver with Master: 21a7e51606124a6eabb827e91a29e94d (127.23.39.194:35173)
I20260811 01:30:44.378396 24353 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:39549
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:30:44.405514 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:44.758706 24712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:44.759027 24712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:44.759141 24712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 01:30:44.764595 24564 heartbeater.cc:503] Master 127.23.39.254:33421 was elected leader, sending a full tablet report...
W20260811 01:30:44.767989 24712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:44.768138 24712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:44.768338 24712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:30:44.778614 24712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:44.780071 24712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:44.781478 24712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:44.795737 24721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:44.795811 24719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:44.796079 24718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:44.796805 24712 server_base.cc:1034] running on GCE node
I20260811 01:30:44.797555 24712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:44.798671 24712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:44.799886 24712 hybrid_clock.cc:648] HybridClock initialized: now 1786411844799814 us; error 60 us; skew 500 ppm
I20260811 01:30:44.800235 24712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:44 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411844, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:44.803678 24712 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:30:44.805275 24712 webserver.cc:460] Webserver started at http://127.23.39.195:37139/ using document root <none> and password file <none>
I20260811 01:30:44.806044 24712 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:44.806234 24712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:44.806599 24712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:44.809800 24712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "b3db5fb00bc2446a98c63a606ae3774c"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "de6ebec8c6050601d61a4af1c1fe4a23"
server_key_iv: "389a45f6e1980cb9c7af2531343a3740"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.810809 24712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "b3db5fb00bc2446a98c63a606ae3774c"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "de6ebec8c6050601d61a4af1c1fe4a23"
server_key_iv: "389a45f6e1980cb9c7af2531343a3740"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.817102 24712 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:30:44.821188 24728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.823035 24712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:30:44.823266 24712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "b3db5fb00bc2446a98c63a606ae3774c"
format_stamp: "Formatted at 2026-08-11 01:30:44 on dist-test-slave-9jjr"
server_key: "de6ebec8c6050601d61a4af1c1fe4a23"
server_key_iv: "389a45f6e1980cb9c7af2531343a3740"
server_key_version: "encryptionkey@0"
I20260811 01:30:44.823530 24712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:44.843232 24712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:44.847642 24712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:44.847918 24712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:44.849015 24712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:30:44.850544 24712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:44.850631 24712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.850731 24712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:44.850780 24712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:44.889341 24712 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:45641
I20260811 01:30:44.889405 24853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:45641 every 8 connection(s)
I20260811 01:30:44.890879 24712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:30:44.899487 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24712
I20260811 01:30:44.899708 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:30:44.900180 23711 external_mini_cluster.cc:1428] Setting key f44494e2ec2f2c2bfc3060dbebd46009
Aug 11 01:30:44 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411844, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:44.913138 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.893736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:57911 (local address 127.23.39.254:33421)
0811 01:30:44.894297 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.894302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.895362 (+ 1060us) server_negotiation.cc:407] Connection header received
0811 01:30:44.897395 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.897401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.897502 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.897634 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:44.899518 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.900535 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.902708 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.903207 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.903328 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:44.907155 (+ 3827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:44.907160 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:44.907163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:44.907202 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:44.910001 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.910813 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.910817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.910820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.910944 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.911346 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.911349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.911351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.911698 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:44.911828 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:44.912598 (+ 770us) server_negotiation.cc:299] Negotiation successful
0811 01:30:44.912838 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":260,"threads_started":1}
I20260811 01:30:44.914245 24858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.894406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33421 (local address 127.23.39.195:57911)
0811 01:30:44.895155 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:44.895196 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:44.897071 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:44.897916 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:44.897926 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:44.898620 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:44.899291 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:44.899312 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.900733 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.900737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:44.902548 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:44.902561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.903487 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.903499 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:44.903748 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:44.904488 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:44.904519 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:44.906919 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:44.910201 (+ 3282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:44.910209 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:44.910224 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:44.910687 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:44.911040 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:44.911044 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:44.911046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:44.911244 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:44.911849 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:44.911856 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:44.912230 (+ 374us) client_negotiation.cc:769] Sending connection context
0811 01:30:44.912493 (+ 263us) client_negotiation.cc:240] Negotiation successful
0811 01:30:44.913000 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":300,"threads_started":1}
I20260811 01:30:44.915902 24855 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33421
I20260811 01:30:44.916234 24855 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:44.917032 24855 heartbeater.cc:511] Master 127.23.39.254:33421 requested a full tablet report, sending...
I20260811 01:30:44.918520 24353 ts_manager.cc:194] Registered new tserver with Master: b3db5fb00bc2446a98c63a606ae3774c (127.23.39.195:45641)
I20260811 01:30:44.919409 24353 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:57911
I20260811 01:30:44.929265 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:30:44.959000 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.936515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53632 (local address 127.23.39.254:33421)
0811 01:30:44.936713 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.936717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.937295 (+ 578us) server_negotiation.cc:407] Connection header received
0811 01:30:44.937524 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.937529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.937615 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.937753 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:44.939563 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.940355 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.941687 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:44.942112 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:44.942315 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:44.952973 (+ 10658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:44.952980 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:44.952984 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:44.953051 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:44.955984 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.956785 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.956791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.956797 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.956954 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:44.957363 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:44.957372 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:44.957375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:44.957724 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:44.957985 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:44.958410 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 01:30:44.958650 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:30:44.966645 24353 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:44.974179 24353 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:45.008374 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.987738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:45641 (local address 127.0.0.1:55828)
0811 01:30:44.988591 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:44.988644 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:44.988831 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:44.999001 (+ 10170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:44.999011 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:44.999047 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:44.999584 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:44.999598 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.002326 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.002336 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.005079 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.005097 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.007163 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.007169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.007418 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.007492 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 01:30:45.007633 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 01:30:45.007898 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":345,"thread_start_us":2585,"threads_started":1}
I20260811 01:30:45.009102 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.989419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34242 (local address 127.23.39.193:33709)
0811 01:30:44.997406 (+ 7987us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.997413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.999235 (+ 1822us) server_negotiation.cc:407] Connection header received
0811 01:30:44.999561 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.999569 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.999807 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.999977 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:45.000823 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.001904 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.005955 (+ 4051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.007622 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.007778 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.008013 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.008272 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.008464 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7798,"thread_start_us":7611,"threads_started":1}
I20260811 01:30:45.009193 24872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.988838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55828 (local address 127.23.39.195:45641)
0811 01:30:44.997907 (+ 9069us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.997913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.997945 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:30:44.998035 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.998041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.998396 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.998641 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:45.000293 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.002113 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.005311 (+ 3198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.006935 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.007088 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.007358 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.008662 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.008897 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8910,"thread_start_us":8770,"threads_started":1}
I20260811 01:30:45.008803 24869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.988710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33709 (local address 127.0.0.1:34242)
0811 01:30:44.999096 (+ 10386us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:44.999116 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:44.999355 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:45.000319 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:45.000323 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:45.000343 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:45.000641 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.000649 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.002059 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.002066 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.005745 (+ 3679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.005762 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.007869 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.007875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.008054 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.008089 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:30:45.008186 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 01:30:45.008347 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10254,"mutex_wait_us":154,"thread_start_us":7822,"threads_started":1}
I20260811 01:30:45.009963 24871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.987870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:35173 (local address 127.0.0.1:45704)
0811 01:30:44.996906 (+ 9036us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:44.996938 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:44.997123 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:44.999584 (+ 2461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:44.999589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:44.999616 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:45.000118 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.000130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.002326 (+ 2196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.002336 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.005749 (+ 3413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.005762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.009043 (+ 3281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.009051 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.009245 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.009281 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:30:45.009391 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:30:45.009514 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8845,"mutex_wait_us":599,"thread_start_us":10920,"threads_started":1}
I20260811 01:30:45.010880 24870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:44.988398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45704 (local address 127.23.39.194:35173)
0811 01:30:44.998661 (+ 10263us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:44.998670 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:44.998701 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:30:44.998817 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:44.998826 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:44.999051 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:44.999292 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:45.000341 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.002120 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.006325 (+ 4205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.008540 (+ 2215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.008685 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.008881 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.010236 (+ 1355us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.010446 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10090,"thread_start_us":9940,"threads_started":1}
I20260811 01:30:45.013630 24782 tablet_service.cc:1467] Processing CreateTablet for tablet f8c83fa30696416ca66ad65b5e68c3b8 (DEFAULT_TABLE table=test-table [id=dffbd174fa834cfbbd9293303787c632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:45.013738 24490 tablet_service.cc:1467] Processing CreateTablet for tablet f8c83fa30696416ca66ad65b5e68c3b8 (DEFAULT_TABLE table=test-table [id=dffbd174fa834cfbbd9293303787c632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:45.015262 24782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c83fa30696416ca66ad65b5e68c3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:45.015275 24490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c83fa30696416ca66ad65b5e68c3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:45.014997 24635 tablet_service.cc:1467] Processing CreateTablet for tablet f8c83fa30696416ca66ad65b5e68c3b8 (DEFAULT_TABLE table=test-table [id=dffbd174fa834cfbbd9293303787c632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:45.016492 24635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8c83fa30696416ca66ad65b5e68c3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:45.028687 24875 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Bootstrap starting.
I20260811 01:30:45.032449 24877 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Bootstrap starting.
I20260811 01:30:45.034741 24875 tablet_bootstrap.cc:654] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:45.036249 24875 log.cc:824] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:45.036648 24877 tablet_bootstrap.cc:654] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:45.038080 24877 log.cc:824] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:45.040063 24875 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: No bootstrap required, opened a new log
I20260811 01:30:45.040455 24875 ts_tablet_manager.cc:1397] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260811 01:30:45.041462 24877 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: No bootstrap required, opened a new log
I20260811 01:30:45.041761 24877 ts_tablet_manager.cc:1397] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260811 01:30:45.046247 24876 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Bootstrap starting.
I20260811 01:30:45.049640 24876 tablet_bootstrap.cc:654] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:45.051136 24876 log.cc:824] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:45.052088 24875 raft_consensus.cc:348] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.052590 24875 raft_consensus.cc:374] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:45.052711 24875 raft_consensus.cc:729] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3db5fb00bc2446a98c63a606ae3774c, State: Initialized, Role: FOLLOWER
I20260811 01:30:45.053004 24877 raft_consensus.cc:348] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.053488 24877 raft_consensus.cc:374] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:45.053606 24877 raft_consensus.cc:729] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7e51606124a6eabb827e91a29e94d, State: Initialized, Role: FOLLOWER
I20260811 01:30:45.053543 24875 consensus_queue.cc:260] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.054399 24877 consensus_queue.cc:260] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.055603 24875 ts_tablet_manager.cc:1428] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Time spent starting tablet: real 0.015s user 0.009s sys 0.007s
I20260811 01:30:45.055639 24706 heartbeater.cc:503] Master 127.23.39.254:33421 was elected leader, sending a full tablet report...
I20260811 01:30:45.056206 24877 ts_tablet_manager.cc:1428] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260811 01:30:45.056514 24855 heartbeater.cc:503] Master 127.23.39.254:33421 was elected leader, sending a full tablet report...
I20260811 01:30:45.056697 24876 tablet_bootstrap.cc:492] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: No bootstrap required, opened a new log
I20260811 01:30:45.057025 24876 ts_tablet_manager.cc:1397] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.000s
I20260811 01:30:45.067412 24876 raft_consensus.cc:348] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.067862 24876 raft_consensus.cc:374] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:45.067947 24876 raft_consensus.cc:729] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1979589afcc9458fab2007917b844287, State: Initialized, Role: FOLLOWER
I20260811 01:30:45.068588 24876 consensus_queue.cc:260] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.070490 24876 ts_tablet_manager.cc:1428] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Time spent starting tablet: real 0.013s user 0.002s sys 0.012s
W20260811 01:30:45.098006 24707 tablet.cc:2369] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:45.142050 24882 raft_consensus.cc:482] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:45.142419 24882 raft_consensus.cc:504] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
W20260811 01:30:45.142776 24856 tablet.cc:2369] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:45.144408 24882 leader_election.cc:288] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3db5fb00bc2446a98c63a606ae3774c (127.23.39.195:45641), 1979589afcc9458fab2007917b844287 (127.23.39.193:33709)
I20260811 01:30:45.151495 24872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.144942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56679 (local address 127.23.39.195:45641)
0811 01:30:45.145187 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.145195 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.145861 (+ 666us) server_negotiation.cc:407] Connection header received
0811 01:30:45.146118 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.146146 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.146229 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.146337 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:45.146950 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.147710 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.149599 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.150492 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.150691 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.150770 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.151082 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.151215 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:30:45.151690 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.144826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:45641 (local address 127.23.39.194:56679)
0811 01:30:45.145715 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:45.145737 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:45.145953 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:45.146371 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:45.146377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:45.146415 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:45.146790 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.146800 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.147861 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.147870 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.149427 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.149440 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.150728 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.150735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.150902 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.150928 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:30:45.151056 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 01:30:45.151204 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"spinlock_wait_cycles":32640,"thread_start_us":559,"threads_started":1}
I20260811 01:30:45.151763 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.145042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:51365 (local address 127.23.39.193:33709)
0811 01:30:45.145260 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.145268 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.146468 (+ 1200us) server_negotiation.cc:407] Connection header received
0811 01:30:45.146753 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.146760 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.146828 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.146929 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:45.147482 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.148193 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.149939 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.150813 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.151003 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.151079 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.151367 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.151505 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:30:45.151947 24885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.145010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33709 (local address 127.23.39.194:51365)
0811 01:30:45.146348 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:45.146364 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:45.146598 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:45.146949 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:45.146954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:45.146978 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:45.147329 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.147337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.148354 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.148361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.149779 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:45.149792 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.151036 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.151042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:45.151210 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.151234 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:30:45.151342 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 01:30:45.151471 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1235,"spinlock_wait_cycles":34176,"thread_start_us":934,"threads_started":1}
I20260811 01:30:45.152774 24805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c83fa30696416ca66ad65b5e68c3b8" candidate_uuid: "21a7e51606124a6eabb827e91a29e94d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3db5fb00bc2446a98c63a606ae3774c" is_pre_election: true
I20260811 01:30:45.152941 24514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c83fa30696416ca66ad65b5e68c3b8" candidate_uuid: "21a7e51606124a6eabb827e91a29e94d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1979589afcc9458fab2007917b844287" is_pre_election: true
I20260811 01:30:45.153357 24805 raft_consensus.cc:2454] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7e51606124a6eabb827e91a29e94d in term 0.
I20260811 01:30:45.153546 24514 raft_consensus.cc:2454] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7e51606124a6eabb827e91a29e94d in term 0.
I20260811 01:30:45.154191 24586 leader_election.cc:302] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1979589afcc9458fab2007917b844287, 21a7e51606124a6eabb827e91a29e94d, b3db5fb00bc2446a98c63a606ae3774c; no voters:
I20260811 01:30:45.154678 24882 raft_consensus.cc:2781] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:45.154881 24882 raft_consensus.cc:482] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:45.155004 24882 raft_consensus.cc:3037] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:45.157312 24882 raft_consensus.cc:504] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.158022 24882 leader_election.cc:288] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [CANDIDATE]: Term 1 election: Requested vote from peers b3db5fb00bc2446a98c63a606ae3774c (127.23.39.195:45641), 1979589afcc9458fab2007917b844287 (127.23.39.193:33709)
I20260811 01:30:45.158490 24805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c83fa30696416ca66ad65b5e68c3b8" candidate_uuid: "21a7e51606124a6eabb827e91a29e94d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3db5fb00bc2446a98c63a606ae3774c"
I20260811 01:30:45.158609 24514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8c83fa30696416ca66ad65b5e68c3b8" candidate_uuid: "21a7e51606124a6eabb827e91a29e94d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1979589afcc9458fab2007917b844287"
I20260811 01:30:45.158720 24805 raft_consensus.cc:3037] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:45.158861 24514 raft_consensus.cc:3037] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:45.161384 24805 raft_consensus.cc:2454] T f8c83fa30696416ca66ad65b5e68c3b8 P b3db5fb00bc2446a98c63a606ae3774c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7e51606124a6eabb827e91a29e94d in term 1.
I20260811 01:30:45.161422 24514 raft_consensus.cc:2454] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7e51606124a6eabb827e91a29e94d in term 1.
I20260811 01:30:45.161919 24588 leader_election.cc:302] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1979589afcc9458fab2007917b844287, 21a7e51606124a6eabb827e91a29e94d, b3db5fb00bc2446a98c63a606ae3774c; no voters:
I20260811 01:30:45.162360 24882 raft_consensus.cc:2781] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:45.162880 24882 raft_consensus.cc:686] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [term 1 LEADER]: Becoming Leader. State: Replica: 21a7e51606124a6eabb827e91a29e94d, State: Running, Role: LEADER
I20260811 01:30:45.163399 24882 consensus_queue.cc:237] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } }
I20260811 01:30:45.168424 24352 catalog_manager.cc:5495] T f8c83fa30696416ca66ad65b5e68c3b8 P 21a7e51606124a6eabb827e91a29e94d reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7e51606124a6eabb827e91a29e94d (127.23.39.194). New cstate: current_term: 1 leader_uuid: "21a7e51606124a6eabb827e91a29e94d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3db5fb00bc2446a98c63a606ae3774c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a7e51606124a6eabb827e91a29e94d" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1979589afcc9458fab2007917b844287" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33709 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:45.211577 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.195838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34248 (local address 127.23.39.193:33709)
0811 01:30:45.196027 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.196032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.196577 (+ 545us) server_negotiation.cc:407] Connection header received
0811 01:30:45.196728 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.196732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.196812 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.196901 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.198534 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.199340 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.200607 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.201085 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.201243 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.205503 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.205521 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.205537 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.205575 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.208509 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.209255 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.209263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.209265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.209406 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.209803 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.209809 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.209812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.210276 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.210587 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.210904 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.211138 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 01:30:45.229285 24565 tablet.cc:2369] T f8c83fa30696416ca66ad65b5e68c3b8 P 1979589afcc9458fab2007917b844287: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:45.271381 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.255149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.23.39.193:33709)
0811 01:30:45.255422 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.255431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.255798 (+ 367us) server_negotiation.cc:407] Connection header received
0811 01:30:45.256037 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.256041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.256148 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.256274 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.257788 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.258662 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.260081 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.260534 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.260721 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.265671 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.265677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.265681 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.265729 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.268670 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.269440 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.269445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.269447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.269616 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.270044 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.270049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.270051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.270449 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.270686 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.270926 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.271117 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:45.331192 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.316105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34266 (local address 127.23.39.193:33709)
0811 01:30:45.316373 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.316387 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.316685 (+ 298us) server_negotiation.cc:407] Connection header received
0811 01:30:45.316907 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.316911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.316978 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.317091 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.318619 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.319350 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.320622 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.321098 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.321246 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.325551 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.325556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.325560 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.325603 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.328455 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.329212 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.329216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.329218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.329367 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.329685 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.329687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.329689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.330006 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.330292 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.330522 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.330707 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 01:30:45.333169 24469 tablet_service.cc:2908] Rejecting scan request for tablet f8c83fa30696416ca66ad65b5e68c3b8: Uninitialized: clean time has not yet been initialized
I20260811 01:30:45.336418 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24423
I20260811 01:30:45.351521 24874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.337640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.23.39.193:33709)
0811 01:30:45.337842 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.337850 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.338206 (+ 356us) server_negotiation.cc:407] Connection header received
0811 01:30:45.338405 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.338410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.338494 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.338597 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.339840 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.340536 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.341771 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.342293 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.342440 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.345770 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.345776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.345779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.345819 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.348663 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.349554 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.349558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.349560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.349691 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.350099 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.350102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.350104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.350483 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.350715 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.351041 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.351230 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:30:45.352227 24559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:45.447265 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24423
I20260811 01:30:45.468629 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24570
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:30:45.484524 24870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.469456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.23.39.194:35173)
0811 01:30:45.469654 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.469658 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.469678 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:30:45.469760 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.469764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.469845 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.469937 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.471236 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.471986 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.473310 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.473770 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.473881 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.478219 (+ 4338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.478237 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.478253 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.478303 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.481435 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.482243 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.482250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.482252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.482406 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.482814 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.482820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.482824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.483237 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.483573 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.483886 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.484183 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:30:45.485229 24701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:45.580715 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24570
I20260811 01:30:45.601526 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24712
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24303](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:30:45.617465 24872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:45.602371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55830 (local address 127.23.39.195:45641)
0811 01:30:45.602559 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:45.602563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:45.602583 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:30:45.602736 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:45.602740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:45.602819 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:45.602906 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:45.604227 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.604973 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.606315 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:45.606719 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:45.606819 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:45.611182 (+ 4363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:45.611199 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:45.611215 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:45.611256 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:45.614571 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.615382 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.615390 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.615392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.615550 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:45.615930 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:45.615933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:45.615935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:45.616326 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:45.616565 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:45.616878 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 01:30:45.617057 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:30:45.618340 24849 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:45.708039 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24712
I20260811 01:30:45.730618 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24317
I20260811 01:30:45.732080 24389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:45.846501 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24317
2026-08-11T01:30:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4611 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24910](info): set up 2 sockets
Aug 11 01:30:45 dist-test-slave-9jjr krb5kdc[24910](info): commencing operation
krb5kdc: starting...
W20260811 01:30:47.011911 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:30:47 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:30:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:30:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:30:47.245857 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45687
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:45687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:47.590731 24925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:47.591147 24925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:47.591331 24925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:47.598851 24925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:30:47.599040 24925 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:30:47.599155 24925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:47.599274 24925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:47.599372 24925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:30:47.599464 24925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:30:47.609892 24925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:45687
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:47.611382 24925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:47.612803 24925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:47.625699 24932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:47.625573 24931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:47.626317 24934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:47.626827 24925 server_base.cc:1034] running on GCE node
I20260811 01:30:47.627816 24925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:47.629397 24925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:47.630666 24925 hybrid_clock.cc:648] HybridClock initialized: now 1786411847630598 us; error 42 us; skew 500 ppm
I20260811 01:30:47.631042 24925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:47 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411847, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:47.634423 24925 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:30:47.636044 24925 webserver.cc:460] Webserver started at http://127.23.39.254:45877/ using document root <none> and password file <none>
I20260811 01:30:47.637097 24925 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:47.637234 24925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:47.637598 24925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:47.640918 24925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "9723478e85d24a499b3453a71f5ef3da"
format_stamp: "Formatted at 2026-08-11 01:30:47 on dist-test-slave-9jjr"
server_key: "ad168a9abfbe96897641fd0c17d0e798"
server_key_iv: "9454368c1ef8ccf0b65858e9ef5f2ed0"
server_key_version: "encryptionkey@0"
I20260811 01:30:47.641826 24925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "9723478e85d24a499b3453a71f5ef3da"
format_stamp: "Formatted at 2026-08-11 01:30:47 on dist-test-slave-9jjr"
server_key: "ad168a9abfbe96897641fd0c17d0e798"
server_key_iv: "9454368c1ef8ccf0b65858e9ef5f2ed0"
server_key_version: "encryptionkey@0"
I20260811 01:30:47.647640 24925 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:30:47.651496 24941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:47.652933 24925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:30:47.653152 24925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "9723478e85d24a499b3453a71f5ef3da"
format_stamp: "Formatted at 2026-08-11 01:30:47 on dist-test-slave-9jjr"
server_key: "ad168a9abfbe96897641fd0c17d0e798"
server_key_iv: "9454368c1ef8ccf0b65858e9ef5f2ed0"
server_key_version: "encryptionkey@0"
I20260811 01:30:47.653409 24925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:47.687201 24925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:47.691879 24925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:47.692201 24925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:47.715497 24925 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:45687
I20260811 01:30:47.715473 25005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:45687 every 8 connection(s)
I20260811 01:30:47.716967 24925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:30:47.719918 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 24925
I20260811 01:30:47.720165 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:30:47.721025 23711 external_mini_cluster.cc:1428] Setting key 873ca0b09594bca35c6bd7263dfacdb2
I20260811 01:30:47.721637 25006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:47.734807 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Bootstrap starting.
Aug 11 01:30:47 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:47.738341 25006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:47.739705 25006 log.cc:824] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:47.742858 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: No bootstrap required, opened a new log
I20260811 01:30:47.745412 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:47.723596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57914 (local address 127.23.39.254:45687)
0811 01:30:47.724385 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:47.724398 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:47.724440 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:30:47.726780 (+ 2340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:47.726804 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:47.727227 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:47.727696 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:47.729264 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:47.730640 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:47.731950 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:47.732709 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:47.732939 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:47.737434 (+ 4495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:47.737442 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:47.737457 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:47.737499 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:47.740944 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:47.741744 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:47.741751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:47.741758 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:47.741956 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:47.742441 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:47.742446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:47.742451 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:47.743043 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:47.743404 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:47.743850 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 01:30:47.744317 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":351,"threads_started":1}
I20260811 01:30:47.752117 25006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } }
I20260811 01:30:47.752732 25006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:47.752857 25006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9723478e85d24a499b3453a71f5ef3da, State: Initialized, Role: FOLLOWER
I20260811 01:30:47.753512 25006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } }
I20260811 01:30:47.753747 25006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:30:47.753852 25006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:30:47.754032 25006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:47.756923 25006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } }
I20260811 01:30:47.757558 25006 leader_election.cc:302] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9723478e85d24a499b3453a71f5ef3da; no voters:
I20260811 01:30:47.758315 25006 leader_election.cc:288] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:30:47.758513 25011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:47.759516 25011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [term 1 LEADER]: Becoming Leader. State: Replica: 9723478e85d24a499b3453a71f5ef3da, State: Running, Role: LEADER
I20260811 01:30:47.760124 25011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } }
I20260811 01:30:47.761013 25006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:30:47.763927 25013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9723478e85d24a499b3453a71f5ef3da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } } }
I20260811 01:30:47.764408 25013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:47.764005 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9723478e85d24a499b3453a71f5ef3da. Latest consensus state: current_term: 1 leader_uuid: "9723478e85d24a499b3453a71f5ef3da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9723478e85d24a499b3453a71f5ef3da" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45687 } } }
I20260811 01:30:47.764596 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:47.766319 25019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:30:47.772199 25019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:30:47.782428 25019 catalog_manager.cc:1347] Generated new cluster ID: f02bfe06f7664de988ad10a84ed1601d
I20260811 01:30:47.782575 25019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:30:47.803587 25019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:30:47.805661 25019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:30:47.818624 25019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Generated new TSK 0
I20260811 01:30:47.819859 25019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:30:47.875065 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45687
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:48.225461 25034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:48.225752 25034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:48.225857 25034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:48.233222 25034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:48.233341 25034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:48.233428 25034 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:48.233502 25034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:30:48.243916 25034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:45687
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:48.245700 25034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:48.247170 25034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:48.260679 25041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:48.260768 25044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:48.260736 25040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:48.261831 25034 server_base.cc:1034] running on GCE node
I20260811 01:30:48.262569 25034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:48.263644 25034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:48.264896 25034 hybrid_clock.cc:648] HybridClock initialized: now 1786411848264813 us; error 65 us; skew 500 ppm
I20260811 01:30:48.265211 25034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:48 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411848, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:48.268875 25034 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:30:48.270545 25034 webserver.cc:460] Webserver started at http://127.23.39.193:41731/ using document root <none> and password file <none>
I20260811 01:30:48.271339 25034 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:48.271473 25034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:48.271862 25034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:48.275085 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "5890caff42af46d8aa3578a4d1f02877"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "95ae0a5a0961d8f5f457b71d55b19b0e"
server_key_iv: "fdaab483bdaa4deedc8fc234a4819a2d"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.275950 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "5890caff42af46d8aa3578a4d1f02877"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "95ae0a5a0961d8f5f457b71d55b19b0e"
server_key_iv: "fdaab483bdaa4deedc8fc234a4819a2d"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.281464 25034 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:30:48.285180 25053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:48.286592 25034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:30:48.286794 25034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "5890caff42af46d8aa3578a4d1f02877"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "95ae0a5a0961d8f5f457b71d55b19b0e"
server_key_iv: "fdaab483bdaa4deedc8fc234a4819a2d"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.287034 25034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:48.320149 25034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:48.325044 25034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:48.325361 25034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:48.328387 25034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:48.328511 25034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:48.328706 25034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:48.328828 25034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 01:30:48 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411848, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:48.353930 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.328947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:39135 (local address 127.23.39.254:45687)
0811 01:30:48.329826 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:48.329833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:48.331018 (+ 1185us) server_negotiation.cc:407] Connection header received
0811 01:30:48.333203 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:48.333209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:48.333313 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:48.333466 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:48.336019 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.337076 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.339943 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.340590 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.340737 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.346294 (+ 5557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:48.346299 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:48.346302 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:48.346338 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:48.349898 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.351012 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.351016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.351019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.351214 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.351929 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.351933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.351935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.352216 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:48.352358 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:48.353483 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0811 01:30:48.353665 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":627,"threads_started":1}
I20260811 01:30:48.356258 25066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.329695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.193:39135)
0811 01:30:48.330811 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:48.330863 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:48.332840 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:48.333878 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:48.333887 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:48.334823 (+ 936us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:48.335813 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.335838 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.337244 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.337252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.339770 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.339783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.340859 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.340867 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.341085 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.341931 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:48.341968 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:48.345928 (+ 3960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:48.350054 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.350064 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.350082 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.350856 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.351372 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.351381 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.351388 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.351734 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.352356 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:48.352367 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:48.352964 (+ 597us) client_negotiation.cc:769] Sending connection context
0811 01:30:48.353389 (+ 425us) client_negotiation.cc:240] Negotiation successful
0811 01:30:48.354169 (+ 780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":479,"threads_started":1}
I20260811 01:30:48.377990 25034 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:36209
I20260811 01:30:48.378036 25186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:36209 every 8 connection(s)
I20260811 01:30:48.379393 25034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:30:48.380496 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.364087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.193:33381)
0811 01:30:48.364810 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:48.364832 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:48.364964 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:48.365381 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:48.365384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:48.365818 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:48.366107 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.366116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.367486 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.367495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.369576 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.369600 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.370676 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.370687 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.370969 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.371908 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:48.371946 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:48.373651 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:48.377503 (+ 3852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.377512 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.377516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.378058 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.378539 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.378544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.378555 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.378689 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.379239 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:48.379245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:48.379446 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 01:30:48.379613 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 01:30:48.379925 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":388,"threads_started":1}
I20260811 01:30:48.380545 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.364084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:33381 (local address 127.23.39.254:45687)
0811 01:30:48.364323 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:48.364332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:48.364923 (+ 591us) server_negotiation.cc:407] Connection header received
0811 01:30:48.365094 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:48.365102 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:48.365212 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:48.365353 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:48.366333 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.367332 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.369766 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.370441 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.370597 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.373930 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:48.373938 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:48.373946 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:48.373991 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:48.377350 (+ 3359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.378258 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.378263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.378267 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.378408 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.378811 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.378817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.378820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.379114 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:48.379278 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:48.379758 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 01:30:48.380059 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:30:48.381832 25187 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45687
I20260811 01:30:48.382158 25187 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:48.383085 25187 heartbeater.cc:511] Master 127.23.39.254:45687 requested a full tablet report, sending...
I20260811 01:30:48.386096 24959 ts_manager.cc:194] Registered new tserver with Master: 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209)
I20260811 01:30:48.387770 24959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:39135
I20260811 01:30:48.388613 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25034
I20260811 01:30:48.388872 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:30:48.389549 23711 external_mini_cluster.cc:1428] Setting key bf842070234bf2dfde7d9d377f9bb124
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:30:48.441424 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45687
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:48.787176 25191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:48.787554 25191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:48.787745 25191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:48.795781 25191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:48.795954 25191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:48.796103 25191 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:48.796252 25191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:30:48.806954 25191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:45687
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:48.808390 25191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:48.809862 25191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:48.823741 25197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:48.823905 25198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:48.823693 25200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:48.825039 25191 server_base.cc:1034] running on GCE node
I20260811 01:30:48.825762 25191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:48.826831 25191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:48.828091 25191 hybrid_clock.cc:648] HybridClock initialized: now 1786411848828011 us; error 48 us; skew 500 ppm
I20260811 01:30:48.828428 25191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:48 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411848, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:48.832015 25191 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:30:48.833674 25191 webserver.cc:460] Webserver started at http://127.23.39.194:38937/ using document root <none> and password file <none>
I20260811 01:30:48.834514 25191 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:48.834632 25191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:48.834939 25191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:48.838295 25191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "f9ffada7cc144aa08e8f0f8d4b783a86"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "2ec173d2245576f79101063184df747d"
server_key_iv: "ebd2ef3c960ce2ee8ea04a684a33d40b"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.839424 25191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "f9ffada7cc144aa08e8f0f8d4b783a86"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "2ec173d2245576f79101063184df747d"
server_key_iv: "ebd2ef3c960ce2ee8ea04a684a33d40b"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.845327 25191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:30:48.849334 25208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:48.850929 25191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:30:48.851138 25191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "f9ffada7cc144aa08e8f0f8d4b783a86"
format_stamp: "Formatted at 2026-08-11 01:30:48 on dist-test-slave-9jjr"
server_key: "2ec173d2245576f79101063184df747d"
server_key_iv: "ebd2ef3c960ce2ee8ea04a684a33d40b"
server_key_version: "encryptionkey@0"
I20260811 01:30:48.851401 25191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:48.865536 25191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:48.870537 25191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:48.870852 25191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:48.873807 25191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:48.873934 25191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:48.874099 25191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:48.874233 25191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 01:30:48 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411848, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:48.903399 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.874783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:43553 (local address 127.23.39.254:45687)
0811 01:30:48.875013 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:48.875020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:48.876611 (+ 1591us) server_negotiation.cc:407] Connection header received
0811 01:30:48.879357 (+ 2746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:48.879367 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:48.879501 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:48.879639 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:48.882408 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.883782 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.886710 (+ 2928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.887484 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.887660 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.894089 (+ 6429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:48.894099 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:48.894105 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:48.894186 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:48.898406 (+ 4220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.899725 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.899732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.899736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.899943 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.900556 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.900563 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.900569 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.901037 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:48.901250 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:48.902545 (+ 1295us) server_negotiation.cc:299] Negotiation successful
0811 01:30:48.902873 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 01:30:48.905206 25219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.875395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.194:43553)
0811 01:30:48.876390 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:48.876445 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:48.878829 (+ 2384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:48.879988 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:48.880011 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:48.880979 (+ 968us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:48.882023 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.882046 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.884017 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.884026 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.886450 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.886495 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.887816 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.887827 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.888256 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.889350 (+ 1094us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:48.889405 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:48.893694 (+ 4289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:48.898593 (+ 4899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.898609 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.898636 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.899510 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.900106 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.900113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.900117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.900402 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.901203 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:48.901214 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:48.901882 (+ 668us) client_negotiation.cc:769] Sending connection context
0811 01:30:48.902341 (+ 459us) client_negotiation.cc:240] Negotiation successful
0811 01:30:48.903137 (+ 796us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":450,"threads_started":1}
I20260811 01:30:48.920102 25191 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:46525
I20260811 01:30:48.920204 25338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:46525 every 8 connection(s)
I20260811 01:30:48.921850 25191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:30:48.924559 25339 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45687
I20260811 01:30:48.924823 25339 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:48.925283 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25191
I20260811 01:30:48.925522 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:30:48.925804 25339 heartbeater.cc:511] Master 127.23.39.254:45687 requested a full tablet report, sending...
I20260811 01:30:48.926117 23711 external_mini_cluster.cc:1428] Setting key 04eb59f80e7f5cddbb2b2c1baef55e57
I20260811 01:30:48.927579 24958 ts_manager.cc:194] Registered new tserver with Master: f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194:46525)
I20260811 01:30:48.928694 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:43553
I20260811 01:30:48.935499 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.914330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:33017 (local address 127.23.39.254:45687)
0811 01:30:48.914599 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:48.914607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:48.918883 (+ 4276us) server_negotiation.cc:407] Connection header received
0811 01:30:48.919054 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:48.919063 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:48.919170 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:48.919314 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:48.920791 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.921929 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.924008 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.924639 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.924785 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.929594 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:48.929608 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:48.929612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:48.929655 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:48.932472 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.933431 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.933434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.933437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.933577 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:48.933998 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:48.934001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:48.934003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:48.934410 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:48.934533 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:48.935029 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 01:30:48.935250 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:30:48.936009 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:48.914403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.194:33017)
0811 01:30:48.918733 (+ 4330us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:48.918764 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:48.918914 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:48.919349 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:48.919356 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:48.920223 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:48.920609 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.920620 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.922115 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.922119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.923848 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:48.923868 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:48.925120 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:48.925128 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:48.925402 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:48.926227 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:48.926253 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:48.929366 (+ 3113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:48.932631 (+ 3265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.932639 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.932646 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.933266 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.933690 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:48.933697 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:48.933703 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:48.933880 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:48.934530 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:48.934537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:48.934765 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 01:30:48.934931 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 01:30:48.935323 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4154,"mutex_wait_us":5,"thread_start_us":3980,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:30:48.978371 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45687
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:49.337778 25343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:49.338101 25343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:49.338303 25343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:49.346276 25343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:49.346406 25343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:49.346587 25343 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:49.346724 25343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:30:49.357409 25343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:45687
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:49.358937 25343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:49.360472 25343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:49.374881 25353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:49.375140 25351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:49.374998 25350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:49.376055 25343 server_base.cc:1034] running on GCE node
I20260811 01:30:49.376812 25343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:49.378209 25343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:49.379509 25343 hybrid_clock.cc:648] HybridClock initialized: now 1786411849379430 us; error 48 us; skew 500 ppm
I20260811 01:30:49.379879 25343 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:49 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:49.383931 25343 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:30:49.385511 25343 webserver.cc:460] Webserver started at http://127.23.39.195:40377/ using document root <none> and password file <none>
I20260811 01:30:49.386340 25343 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:49.386485 25343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:49.386848 25343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:49.390247 25343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
format_stamp: "Formatted at 2026-08-11 01:30:49 on dist-test-slave-9jjr"
server_key: "28d108d9639c60b82a8ea0c42ad1c5c0"
server_key_iv: "5cec5b4ced1ae75db8827b4d9011105d"
server_key_version: "encryptionkey@0"
I20260811 01:30:49.390812 25187 heartbeater.cc:503] Master 127.23.39.254:45687 was elected leader, sending a full tablet report...
I20260811 01:30:49.391294 25343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
format_stamp: "Formatted at 2026-08-11 01:30:49 on dist-test-slave-9jjr"
server_key: "28d108d9639c60b82a8ea0c42ad1c5c0"
server_key_iv: "5cec5b4ced1ae75db8827b4d9011105d"
server_key_version: "encryptionkey@0"
I20260811 01:30:49.397197 25343 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:30:49.401106 25360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:49.402741 25343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:30:49.402907 25343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
format_stamp: "Formatted at 2026-08-11 01:30:49 on dist-test-slave-9jjr"
server_key: "28d108d9639c60b82a8ea0c42ad1c5c0"
server_key_iv: "5cec5b4ced1ae75db8827b4d9011105d"
server_key_version: "encryptionkey@0"
I20260811 01:30:49.403153 25343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:49.420385 25343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:49.425426 25343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:49.425776 25343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:49.429018 25343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:49.429180 25343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:49.429356 25343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:49.429438 25343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:30:49 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:49.459331 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.429943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:45951 (local address 127.23.39.254:45687)
0811 01:30:49.430243 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.430250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.432095 (+ 1845us) server_negotiation.cc:407] Connection header received
0811 01:30:49.434826 (+ 2731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.434833 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.434957 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.435099 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:49.438623 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.439698 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.442307 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.443280 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.443484 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.449732 (+ 6248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:49.449742 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:49.449748 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:49.449799 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:49.454198 (+ 4399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.455561 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.455571 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.455578 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.455822 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.456456 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.456463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.456470 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.456954 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:49.457155 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.458631 (+ 1476us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.458921 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:30:49.461043 25371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.430869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.195:45951)
0811 01:30:49.431839 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.431887 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.434378 (+ 2491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.435691 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.435711 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.436978 (+ 1267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:49.438293 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.438338 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.440070 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.440074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.442040 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.442065 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.443563 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.443568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.443786 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.444799 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:49.444836 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:49.449323 (+ 4487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:49.454510 (+ 5187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:49.454524 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:49.454555 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:49.455340 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:49.455964 (+ 624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:49.455968 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:49.455970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:49.456273 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:49.457282 (+ 1009us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:49.457291 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:49.457929 (+ 638us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.458472 (+ 543us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.459166 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":414,"threads_started":1}
I20260811 01:30:49.477082 25343 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:41185
I20260811 01:30:49.477106 25491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:41185 every 8 connection(s)
I20260811 01:30:49.478820 25343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:30:49.481562 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25343
I20260811 01:30:49.481774 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:30:49.482321 23711 external_mini_cluster.cc:1428] Setting key 02fb22f349b64a9200a48aee00fbefea
I20260811 01:30:49.481526 25492 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45687
I20260811 01:30:49.482647 25492 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:49.483713 25492 heartbeater.cc:511] Master 127.23.39.254:45687 requested a full tablet report, sending...
I20260811 01:30:49.485275 24959 ts_manager.cc:194] Registered new tserver with Master: c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:49.485742 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.469686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:54765 (local address 127.23.39.254:45687)
0811 01:30:49.469935 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.469945 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.470672 (+ 727us) server_negotiation.cc:407] Connection header received
0811 01:30:49.470923 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.470929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.471046 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.471154 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:49.472987 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.474094 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.475947 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.476503 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.476657 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.478949 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:49.478957 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:49.478962 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:49.479006 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:49.482596 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.483460 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.483466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.483470 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.483679 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.484078 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.484083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.484087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.484495 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:49.484699 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.485114 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.485364 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:30:49.485828 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.469226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.23.39.195:54765)
0811 01:30:49.470538 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.470562 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.470764 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.471354 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.471358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.472139 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:49.472719 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.472745 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.474334 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.474340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.475769 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.475785 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.476741 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.476758 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.476966 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.477779 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:49.477799 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:49.478678 (+ 879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:49.482767 (+ 4089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:49.482772 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:49.482776 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:49.483323 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:49.483784 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:49.483789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:49.483794 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:49.483960 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:49.484653 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:49.484658 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:49.484860 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.485018 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.485385 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1170,"thread_start_us":933,"threads_started":1}
I20260811 01:30:49.486474 24959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:45951
I20260811 01:30:49.499796 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:30:49 dist-test-slave-9jjr krb5kdc[24910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:30:49 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:49.554863 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.540349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57926 (local address 127.23.39.254:45687)
0811 01:30:49.540539 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.540544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.540884 (+ 340us) server_negotiation.cc:407] Connection header received
0811 01:30:49.541047 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.541051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.541139 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.541239 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:49.542828 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.543593 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.544912 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.545348 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.545466 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.549706 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:49.549712 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:49.549717 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:49.549758 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:49.552427 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.553109 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.553113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.553116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.553272 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:49.553608 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:49.553611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:49.553613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:49.553890 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:49.554097 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.554402 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.554590 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:30:49.559779 24958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:49.567780 24958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:49.610365 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.583206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53980 (local address 127.23.39.195:41185)
0811 01:30:49.600648 (+ 17442us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.600661 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.600706 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:30:49.600839 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.600849 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.601184 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.601439 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:49.602571 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.604347 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.607687 (+ 3340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.608981 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609146 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.609424 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.609789 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.609964 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17175,"thread_start_us":16919,"threads_started":1}
I20260811 01:30:49.610450 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.582283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:41185 (local address 127.0.0.1:53980)
0811 01:30:49.599532 (+ 17249us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.599558 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.599723 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.601520 (+ 1797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.601532 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.601569 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:49.602120 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.602165 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.604545 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.604557 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.607489 (+ 2932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.607503 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.609200 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609217 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.609494 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.609555 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.609704 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.609943 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17113,"mutex_wait_us":140,"thread_start_us":16652,"threads_started":1}
I20260811 01:30:49.610819 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.581803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.23.39.193:36209)
0811 01:30:49.602243 (+ 20440us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.602252 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.602282 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:30:49.602397 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.602405 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.602620 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.602822 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:49.603661 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.604836 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.607620 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.609112 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609249 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.609638 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.610348 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.610520 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19372,"thread_start_us":19227,"threads_started":1}
I20260811 01:30:49.611224 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.582174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46525 (local address 127.0.0.1:56646)
0811 01:30:49.598786 (+ 16612us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.598822 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.598987 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.601756 (+ 2769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.601761 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.601782 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:49.602264 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.602277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.604512 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.604518 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.607197 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.607214 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.609493 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609501 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.609705 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.609740 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.609815 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.609987 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16436,"mutex_wait_us":6,"thread_start_us":17072,"threads_started":1}
I20260811 01:30:49.611392 25505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.581632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:36209 (local address 127.0.0.1:52512)
0811 01:30:49.597525 (+ 15893us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.597590 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.597884 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.603131 (+ 5247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.603135 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.603168 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:49.603474 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.603482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.605004 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.605010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.607419 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.607438 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.609729 (+ 2291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609737 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.609938 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.609968 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.610049 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.610208 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15485,"mutex_wait_us":33,"thread_start_us":15307,"threads_started":1}
I20260811 01:30:49.612455 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.583148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56646 (local address 127.23.39.194:46525)
0811 01:30:49.601063 (+ 17915us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.601072 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.601106 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:30:49.601210 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.601218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.601497 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.602472 (+ 975us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:49.602726 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.604334 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.607408 (+ 3074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.609089 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.609249 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.611870 (+ 2621us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.611950 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.612127 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17688,"thread_start_us":17491,"threads_started":1}
I20260811 01:30:49.615067 25415 tablet_service.cc:1467] Processing CreateTablet for tablet 178a357558c84325827e219b01aac5e3 (DEFAULT_TABLE table=test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.615315 25111 tablet_service.cc:1467] Processing CreateTablet for tablet 178a357558c84325827e219b01aac5e3 (DEFAULT_TABLE table=test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.616120 25262 tablet_service.cc:1467] Processing CreateTablet for tablet 178a357558c84325827e219b01aac5e3 (DEFAULT_TABLE table=test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.616988 25111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178a357558c84325827e219b01aac5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.617383 25415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178a357558c84325827e219b01aac5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.617476 25262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178a357558c84325827e219b01aac5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.634209 25512 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Bootstrap starting.
I20260811 01:30:49.636189 25513 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Bootstrap starting.
I20260811 01:30:49.638787 25512 tablet_bootstrap.cc:654] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.640388 25512 log.cc:824] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:49.641222 25513 tablet_bootstrap.cc:654] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.641778 25514 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Bootstrap starting.
I20260811 01:30:49.642930 25513 log.cc:824] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:49.644951 25512 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: No bootstrap required, opened a new log
I20260811 01:30:49.645352 25512 ts_tablet_manager.cc:1397] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260811 01:30:49.646273 25514 tablet_bootstrap.cc:654] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.647461 25514 log.cc:824] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:49.648351 25513 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: No bootstrap required, opened a new log
I20260811 01:30:49.648689 25513 ts_tablet_manager.cc:1397] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260811 01:30:49.650632 25514 tablet_bootstrap.cc:492] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: No bootstrap required, opened a new log
I20260811 01:30:49.650936 25514 ts_tablet_manager.cc:1397] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260811 01:30:49.659648 25514 raft_consensus.cc:348] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.659736 25512 raft_consensus.cc:348] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.660202 25514 raft_consensus.cc:374] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.660254 25512 raft_consensus.cc:374] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.660004 25513 raft_consensus.cc:348] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.660306 25514 raft_consensus.cc:729] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9ffada7cc144aa08e8f0f8d4b783a86, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.660349 25512 raft_consensus.cc:729] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5890caff42af46d8aa3578a4d1f02877, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.660447 25513 raft_consensus.cc:374] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.660593 25513 raft_consensus.cc:729] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e39b811e9a46eaae2653c3e5c7567a, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.661120 25512 consensus_queue.cc:260] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.661108 25513 consensus_queue.cc:260] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.661201 25514 consensus_queue.cc:260] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.663434 25512 ts_tablet_manager.cc:1428] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Time spent starting tablet: real 0.018s user 0.010s sys 0.006s
I20260811 01:30:49.663682 25513 ts_tablet_manager.cc:1428] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260811 01:30:49.663846 25339 heartbeater.cc:503] Master 127.23.39.254:45687 was elected leader, sending a full tablet report...
I20260811 01:30:49.664172 25492 heartbeater.cc:503] Master 127.23.39.254:45687 was elected leader, sending a full tablet report...
I20260811 01:30:49.664494 25514 ts_tablet_manager.cc:1428] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
W20260811 01:30:49.674376 25340 tablet.cc:2369] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:49.701375 25519 raft_consensus.cc:482] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:49.701813 25519 raft_consensus.cc:504] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.703979 25519 leader_election.cc:288] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:49.712261 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.704386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:34911 (local address 127.23.39.193:36209)
0811 01:30:49.704643 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.704653 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.705729 (+ 1076us) server_negotiation.cc:407] Connection header received
0811 01:30:49.705988 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.705992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.706107 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.706228 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:49.707068 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.707938 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.710271 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.711142 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.711355 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.711440 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.711808 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.711951 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:30:49.712280 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.704672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:37095 (local address 127.23.39.195:41185)
0811 01:30:49.704907 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.704914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.705833 (+ 919us) server_negotiation.cc:407] Connection header received
0811 01:30:49.706043 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.706048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.706110 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.706254 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:49.707074 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.707914 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.710272 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.711095 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.711326 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.711416 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.711856 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.712004 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 01:30:49.712494 25521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.704348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:36209 (local address 127.23.39.194:34911)
0811 01:30:49.705531 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.705548 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.705814 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.706270 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.706276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.706303 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:49.706899 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.706911 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.708070 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.708078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.710078 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.710091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.711396 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.711403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.711632 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.711662 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.711778 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.711932 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"mutex_wait_us":114,"thread_start_us":730,"threads_started":1}
I20260811 01:30:49.712538 25522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.704591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:41185 (local address 127.23.39.194:37095)
0811 01:30:49.705709 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.705724 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.705893 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.706270 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.706275 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.706328 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:49.706901 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.706912 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.708102 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.708105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.710041 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.710055 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.711361 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.711367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:49.711562 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.711623 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 01:30:49.711821 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 01:30:49.711963 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":61,"spinlock_wait_cycles":33024,"thread_start_us":732,"threads_started":1}
I20260811 01:30:49.713732 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178a357558c84325827e219b01aac5e3" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" is_pre_election: true
I20260811 01:30:49.714011 25132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178a357558c84325827e219b01aac5e3" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5890caff42af46d8aa3578a4d1f02877" is_pre_election: true
I20260811 01:30:49.714418 25441 raft_consensus.cc:2454] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 0.
I20260811 01:30:49.714581 25132 raft_consensus.cc:2454] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 0.
I20260811 01:30:49.715390 25213 leader_election.cc:302] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5890caff42af46d8aa3578a4d1f02877, c3e39b811e9a46eaae2653c3e5c7567a, f9ffada7cc144aa08e8f0f8d4b783a86; no voters:
I20260811 01:30:49.715911 25519 raft_consensus.cc:2781] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:49.716087 25519 raft_consensus.cc:482] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:49.716188 25519 raft_consensus.cc:3037] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.719583 25519 raft_consensus.cc:504] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.720424 25519 leader_election.cc:288] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 election: Requested vote from peers 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:49.721088 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178a357558c84325827e219b01aac5e3" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
I20260811 01:30:49.721088 25132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178a357558c84325827e219b01aac5e3" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5890caff42af46d8aa3578a4d1f02877"
I20260811 01:30:49.721342 25441 raft_consensus.cc:3037] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.721326 25132 raft_consensus.cc:3037] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.724016 25441 raft_consensus.cc:2454] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 1.
I20260811 01:30:49.724632 25211 leader_election.cc:302] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e39b811e9a46eaae2653c3e5c7567a, f9ffada7cc144aa08e8f0f8d4b783a86; no voters:
I20260811 01:30:49.724915 25132 raft_consensus.cc:2454] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 1.
I20260811 01:30:49.725059 25519 raft_consensus.cc:2781] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:49.725657 25519 raft_consensus.cc:686] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 LEADER]: Becoming Leader. State: Replica: f9ffada7cc144aa08e8f0f8d4b783a86, State: Running, Role: LEADER
I20260811 01:30:49.726318 25519 consensus_queue.cc:237] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
W20260811 01:30:49.730863 25493 tablet.cc:2369] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:49.732354 24958 catalog_manager.cc:5495] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } health_report { overall_health: UNKNOWN } } }
I20260811 01:30:49.777894 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.772462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.23.39.194:46525)
0811 01:30:49.772655 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.772660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.772680 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:30:49.772866 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.772870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.772952 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.773090 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:49.773495 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.774355 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.775724 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:49.776159 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:49.776256 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:49.776761 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:49.777311 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:49.777431 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:49.777569 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 01:30:49.777645 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:30:49.787045 25132 raft_consensus.cc:1261] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Refusing update from remote peer f9ffada7cc144aa08e8f0f8d4b783a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:49.787045 25441 raft_consensus.cc:1261] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Refusing update from remote peer f9ffada7cc144aa08e8f0f8d4b783a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:49.788160 25523 consensus_queue.cc:1035] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:49.788543 25519 consensus_queue.cc:1035] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:49.826768 24959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:49.827119 24959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:49.832208 24959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Sending DeleteTablet for 3 replicas of tablet 178a357558c84325827e219b01aac5e3
I20260811 01:30:49.833763 25262 tablet_service.cc:1514] Processing DeleteTablet for tablet 178a357558c84325827e219b01aac5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:49 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:56646
I20260811 01:30:49.833761 25111 tablet_service.cc:1514] Processing DeleteTablet for tablet 178a357558c84325827e219b01aac5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:49 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:52512
I20260811 01:30:49.833884 25415 tablet_service.cc:1514] Processing DeleteTablet for tablet 178a357558c84325827e219b01aac5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:49 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:53980
I20260811 01:30:49.840265 24959 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:49.841428 24959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:49.853681 25414 tablet_service.cc:1467] Processing CreateTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 (DEFAULT_TABLE table=test-table [id=485cbb2f29254c9e955cd2d3716f5064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.853807 25110 tablet_service.cc:1467] Processing CreateTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 (DEFAULT_TABLE table=test-table [id=485cbb2f29254c9e955cd2d3716f5064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.854094 25261 tablet_service.cc:1467] Processing CreateTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 (DEFAULT_TABLE table=test-table [id=485cbb2f29254c9e955cd2d3716f5064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:49.854540 25110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a45c5c4e2247cb9e17fab33b3971f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.854583 25414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a45c5c4e2247cb9e17fab33b3971f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.854732 25261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8a45c5c4e2247cb9e17fab33b3971f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:49.861991 25512 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Bootstrap starting.
I20260811 01:30:49.863407 25514 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Bootstrap starting.
I20260811 01:30:49.864061 25512 tablet_bootstrap.cc:654] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.865473 25537 tablet_replica.cc:330] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: stopping tablet replica
I20260811 01:30:49.866216 25537 raft_consensus.cc:2229] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:49.866954 25537 raft_consensus.cc:2258] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:49.867149 25513 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Bootstrap starting.
I20260811 01:30:49.868041 25536 tablet_replica.cc:330] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: stopping tablet replica
I20260811 01:30:49.868712 25538 tablet_replica.cc:330] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: stopping tablet replica
I20260811 01:30:49.868350 25514 tablet_bootstrap.cc:654] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.869244 25513 tablet_bootstrap.cc:654] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:49.869494 25536 raft_consensus.cc:2229] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:30:49.870368 25536 raft_consensus.cc:2258] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:49.869246 25538 raft_consensus.cc:2229] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:49.871690 25538 raft_consensus.cc:2258] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:49.872563 25537 ts_tablet_manager.cc:1905] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:49.873507 25512 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: No bootstrap required, opened a new log
I20260811 01:30:49.873688 25512 ts_tablet_manager.cc:1397] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260811 01:30:49.874028 25513 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: No bootstrap required, opened a new log
I20260811 01:30:49.874202 25513 ts_tablet_manager.cc:1397] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260811 01:30:49.874927 25538 ts_tablet_manager.cc:1905] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:49.874738 25512 raft_consensus.cc:348] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.875062 25512 raft_consensus.cc:374] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.875182 25512 raft_consensus.cc:729] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5890caff42af46d8aa3578a4d1f02877, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.875108 25513 raft_consensus.cc:348] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.875332 25513 raft_consensus.cc:374] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.875433 25513 raft_consensus.cc:729] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e39b811e9a46eaae2653c3e5c7567a, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.875504 25512 consensus_queue.cc:260] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.875727 25513 consensus_queue.cc:260] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.876339 25513 ts_tablet_manager.cc:1428] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 01:30:49.878404 25512 ts_tablet_manager.cc:1428] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 01:30:49.879557 25536 ts_tablet_manager.cc:1905] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:49.883742 25538 ts_tablet_manager.cc:1918] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:30:49.883963 25538 log.cc:1196] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/178a357558c84325827e219b01aac5e3
I20260811 01:30:49.884639 25538 ts_tablet_manager.cc:1939] T 178a357558c84325827e219b01aac5e3 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting consensus metadata
I20260811 01:30:49.886931 24943 catalog_manager.cc:4841] TS c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185): tablet 178a357558c84325827e219b01aac5e3 (table test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]) successfully deleted
W20260811 01:30:49.888420 25188 tablet.cc:2369] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:49.889694 25537 ts_tablet_manager.cc:1918] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:30:49.890646 25537 log.cc:1196] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/178a357558c84325827e219b01aac5e3
I20260811 01:30:49.891319 25537 ts_tablet_manager.cc:1939] T 178a357558c84325827e219b01aac5e3 P 5890caff42af46d8aa3578a4d1f02877: Deleting consensus metadata
I20260811 01:30:49.891311 25536 ts_tablet_manager.cc:1918] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:30:49.891505 25536 log.cc:1196] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/178a357558c84325827e219b01aac5e3
I20260811 01:30:49.892102 25514 tablet_bootstrap.cc:492] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: No bootstrap required, opened a new log
I20260811 01:30:49.892145 25536 ts_tablet_manager.cc:1939] T 178a357558c84325827e219b01aac5e3 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting consensus metadata
I20260811 01:30:49.892292 25514 ts_tablet_manager.cc:1397] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.006s
I20260811 01:30:49.893301 25514 raft_consensus.cc:348] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.893535 24945 catalog_manager.cc:4841] TS 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209): tablet 178a357558c84325827e219b01aac5e3 (table test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]) successfully deleted
I20260811 01:30:49.893592 25514 raft_consensus.cc:374] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:49.893703 25514 raft_consensus.cc:729] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9ffada7cc144aa08e8f0f8d4b783a86, State: Initialized, Role: FOLLOWER
I20260811 01:30:49.894035 24944 catalog_manager.cc:4841] TS f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194:46525): tablet 178a357558c84325827e219b01aac5e3 (table test-table [id=1fdae2c1a7594f3c8f6bf6d45a7320af]) successfully deleted
I20260811 01:30:49.893980 25514 consensus_queue.cc:260] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.894856 25514 ts_tablet_manager.cc:1428] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:30:49.939348 25519 raft_consensus.cc:482] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:49.939582 25519 raft_consensus.cc:504] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.940366 25519 leader_election.cc:288] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:49.941027 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a45c5c4e2247cb9e17fab33b3971f9" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" is_pre_election: true
I20260811 01:30:49.941042 25132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a45c5c4e2247cb9e17fab33b3971f9" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5890caff42af46d8aa3578a4d1f02877" is_pre_election: true
I20260811 01:30:49.941334 25441 raft_consensus.cc:2454] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 0.
I20260811 01:30:49.941334 25132 raft_consensus.cc:2454] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 0.
I20260811 01:30:49.941812 25211 leader_election.cc:302] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e39b811e9a46eaae2653c3e5c7567a, f9ffada7cc144aa08e8f0f8d4b783a86; no voters:
I20260811 01:30:49.942166 25519 raft_consensus.cc:2781] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:49.942338 25519 raft_consensus.cc:482] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:49.942448 25519 raft_consensus.cc:3037] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.944821 25519 raft_consensus.cc:504] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.945539 25519 leader_election.cc:288] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 election: Requested vote from peers 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:49.946085 25132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a45c5c4e2247cb9e17fab33b3971f9" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5890caff42af46d8aa3578a4d1f02877"
I20260811 01:30:49.946115 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8a45c5c4e2247cb9e17fab33b3971f9" candidate_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
I20260811 01:30:49.946391 25132 raft_consensus.cc:3037] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.946403 25441 raft_consensus.cc:3037] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:49.949126 25441 raft_consensus.cc:2454] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 1.
I20260811 01:30:49.949586 25211 leader_election.cc:302] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e39b811e9a46eaae2653c3e5c7567a, f9ffada7cc144aa08e8f0f8d4b783a86; no voters:
I20260811 01:30:49.949940 25519 raft_consensus.cc:2781] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:49.949960 25132 raft_consensus.cc:2454] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ffada7cc144aa08e8f0f8d4b783a86 in term 1.
I20260811 01:30:49.950165 25519 raft_consensus.cc:686] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 LEADER]: Becoming Leader. State: Replica: f9ffada7cc144aa08e8f0f8d4b783a86, State: Running, Role: LEADER
I20260811 01:30:49.950480 25519 consensus_queue.cc:237] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:49.953351 24959 catalog_manager.cc:5495] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411847, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:50.022507 25550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.996932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45687 (local address 127.0.0.1:57928)
0811 01:30:49.997623 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:49.997640 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:49.997783 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:49.998202 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:49.998206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:49.998976 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:49.999284 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:49.999294 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.000826 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.000830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.001819 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.001830 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.002878 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.002882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.003126 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.012178 (+ 9052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:50.012210 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:50.014868 (+ 2658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:50.019493 (+ 4625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:50.019512 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:50.019518 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:50.020126 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:50.020632 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:50.020636 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:50.020638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:50.020793 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:50.021490 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:50.021497 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:50.021676 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.021831 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.022058 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":392,"threads_started":1}
I20260811 01:30:50.022732 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:49.996815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.23.39.254:45687)
0811 01:30:49.996997 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:49.997002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:49.997741 (+ 739us) server_negotiation.cc:407] Connection header received
0811 01:30:49.997904 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:49.997910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:49.997998 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:49.998112 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:49.999455 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.000664 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.001974 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.002689 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.002829 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.015258 (+ 12429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.015266 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.015271 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.015352 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.019296 (+ 3944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.020294 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.020301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.020307 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.020498 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.020906 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.020912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.020915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.021352 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.021517 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.021976 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.022266 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:30:50.029106 24959 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57928:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:30:50.030800 24959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:50.039563 25415 tablet_service.cc:1467] Processing CreateTablet for tablet f551648b9db6419f9b5615098af29e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=23d50519c21945f2a12d5264b86e06bb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:50.039505 25110 tablet_service.cc:1467] Processing CreateTablet for tablet f551648b9db6419f9b5615098af29e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=23d50519c21945f2a12d5264b86e06bb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:50.040115 25110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f551648b9db6419f9b5615098af29e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:50.040136 25415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f551648b9db6419f9b5615098af29e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:50.046803 25262 tablet_service.cc:1467] Processing CreateTablet for tablet f551648b9db6419f9b5615098af29e78 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=23d50519c21945f2a12d5264b86e06bb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:50.047479 25262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f551648b9db6419f9b5615098af29e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:50.050390 25513 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: Bootstrap starting.
I20260811 01:30:50.051959 25513 tablet_bootstrap.cc:654] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:50.054388 25513 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: No bootstrap required, opened a new log
I20260811 01:30:50.054589 25513 ts_tablet_manager.cc:1397] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:30:50.055541 25513 raft_consensus.cc:348] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.055823 25513 raft_consensus.cc:374] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:50.055922 25513 raft_consensus.cc:729] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e39b811e9a46eaae2653c3e5c7567a, State: Initialized, Role: FOLLOWER
I20260811 01:30:50.056183 25513 consensus_queue.cc:260] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.056922 25513 ts_tablet_manager.cc:1428] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:30:50.056833 25520 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.057233 25520 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.061014 25512 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: Bootstrap starting.
I20260811 01:30:50.061983 25514 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: Bootstrap starting.
I20260811 01:30:50.063086 25512 tablet_bootstrap.cc:654] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:50.064126 25514 tablet_bootstrap.cc:654] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:50.066296 25512 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: No bootstrap required, opened a new log
I20260811 01:30:50.066542 25512 ts_tablet_manager.cc:1397] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260811 01:30:50.067349 25512 raft_consensus.cc:348] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.067624 25512 raft_consensus.cc:374] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:50.067727 25512 raft_consensus.cc:729] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5890caff42af46d8aa3578a4d1f02877, State: Initialized, Role: FOLLOWER
I20260811 01:30:50.068007 25512 consensus_queue.cc:260] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.068692 25512 ts_tablet_manager.cc:1428] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 01:30:50.068517 25518 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.068938 25518 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.069720 25514 tablet_bootstrap.cc:492] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: No bootstrap required, opened a new log
I20260811 01:30:50.069952 25514 ts_tablet_manager.cc:1397] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 01:30:50.070678 25514 raft_consensus.cc:348] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.072181 25514 raft_consensus.cc:374] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:50.072286 25514 raft_consensus.cc:729] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9ffada7cc144aa08e8f0f8d4b783a86, State: Initialized, Role: FOLLOWER
I20260811 01:30:50.072512 25514 consensus_queue.cc:260] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.073135 25514 ts_tablet_manager.cc:1428] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 01:30:50.072947 25519 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.073324 25519 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.131659 25518 raft_consensus.cc:482] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:50.131939 25518 raft_consensus.cc:504] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.133630 25518 leader_election.cc:288] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194:46525), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:50.142958 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.134418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:48605 (local address 127.23.39.195:41185)
0811 01:30:50.134620 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.134627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.135611 (+ 984us) server_negotiation.cc:407] Connection header received
0811 01:30:50.135897 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.135904 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.135990 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.136109 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:50.137019 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.138232 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.140537 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.141748 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.141935 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.142019 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.142483 (+ 464us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.142639 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:30:50.143049 25557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.134671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:41185 (local address 127.23.39.193:48605)
0811 01:30:50.135507 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:50.135525 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:50.135710 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:50.136146 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:50.136151 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:50.136184 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:50.136808 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.136823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.138397 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.138402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.140344 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.140361 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.142026 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.142034 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.142263 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.142312 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.142424 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.142584 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":61,"thread_start_us":469,"threads_started":1}
I20260811 01:30:50.143853 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f551648b9db6419f9b5615098af29e78" candidate_uuid: "5890caff42af46d8aa3578a4d1f02877" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" is_pre_election: true
I20260811 01:30:50.144209 25441 raft_consensus.cc:2454] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5890caff42af46d8aa3578a4d1f02877 in term 0.
I20260811 01:30:50.144306 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.134261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:55397 (local address 127.23.39.194:46525)
0811 01:30:50.134542 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.134552 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.135313 (+ 761us) server_negotiation.cc:407] Connection header received
0811 01:30:50.135673 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.135680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.135796 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.135915 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:50.136757 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.138103 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.140969 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.142458 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.142627 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.142698 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.143794 (+ 1096us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.143952 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 01:30:50.144661 25556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.133811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46525 (local address 127.23.39.193:55397)
0811 01:30:50.135158 (+ 1347us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:50.135183 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:50.135466 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:50.135941 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:50.135945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:50.135970 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:50.136542 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.136560 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.138301 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.138309 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.140779 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.140795 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.142882 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.142888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.143587 (+ 699us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.143630 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.143761 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.143907 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"mutex_wait_us":106,"thread_start_us":994,"threads_started":1}
I20260811 01:30:50.144933 25057 leader_election.cc:302] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5890caff42af46d8aa3578a4d1f02877, c3e39b811e9a46eaae2653c3e5c7567a; no voters:
I20260811 01:30:50.145512 25518 raft_consensus.cc:2781] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:50.145669 25518 raft_consensus.cc:482] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:50.145771 25518 raft_consensus.cc:3037] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:50.145911 25283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f551648b9db6419f9b5615098af29e78" candidate_uuid: "5890caff42af46d8aa3578a4d1f02877" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" is_pre_election: true
I20260811 01:30:50.146502 25283 raft_consensus.cc:2454] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5890caff42af46d8aa3578a4d1f02877 in term 0.
I20260811 01:30:50.148941 25518 raft_consensus.cc:504] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.149643 25518 leader_election.cc:288] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [CANDIDATE]: Term 1 election: Requested vote from peers f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194:46525), c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185)
I20260811 01:30:50.150272 25283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f551648b9db6419f9b5615098af29e78" candidate_uuid: "5890caff42af46d8aa3578a4d1f02877" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86"
I20260811 01:30:50.150329 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f551648b9db6419f9b5615098af29e78" candidate_uuid: "5890caff42af46d8aa3578a4d1f02877" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e39b811e9a46eaae2653c3e5c7567a"
I20260811 01:30:50.150527 25283 raft_consensus.cc:3037] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:50.150622 25441 raft_consensus.cc:3037] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:50.153144 25283 raft_consensus.cc:2454] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5890caff42af46d8aa3578a4d1f02877 in term 1.
I20260811 01:30:50.153740 25058 leader_election.cc:302] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5890caff42af46d8aa3578a4d1f02877, f9ffada7cc144aa08e8f0f8d4b783a86; no voters:
I20260811 01:30:50.153991 25441 raft_consensus.cc:2454] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5890caff42af46d8aa3578a4d1f02877 in term 1.
I20260811 01:30:50.154098 25518 raft_consensus.cc:2781] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:50.161696 25518 raft_consensus.cc:686] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [term 1 LEADER]: Becoming Leader. State: Replica: 5890caff42af46d8aa3578a4d1f02877, State: Running, Role: LEADER
I20260811 01:30:50.162298 25518 consensus_queue.cc:237] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } }
I20260811 01:30:50.165102 25558 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: TxnStatusTablet state changed. Reason: New leader 5890caff42af46d8aa3578a4d1f02877. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.165660 25558 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:50.166762 25560 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:30:50.167182 25560 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:30:50.167479 24959 catalog_manager.cc:5495] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } health_report { overall_health: UNKNOWN } } }
I20260811 01:30:50.210232 25550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.202042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:36209 (local address 127.0.0.1:52514)
0811 01:30:50.202368 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:50.202392 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:50.202545 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:50.203173 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:50.203179 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:50.203193 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:50.203459 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.203474 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.205009 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.205015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.206658 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.206674 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.207868 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.207877 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.208096 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.208178 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.209539 (+ 1361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.209567 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.209669 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.209850 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:30:50.210270 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.202471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.23.39.193:36209)
0811 01:30:50.202660 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.202666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.202688 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:30:50.202801 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.202810 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.202934 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.203113 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:50.203639 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.204855 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.206821 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.207552 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.207715 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.208424 (+ 709us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.209403 (+ 979us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.209564 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.209714 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.209830 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:30:50.216073 25441 raft_consensus.cc:1261] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Refusing update from remote peer 5890caff42af46d8aa3578a4d1f02877: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:50.216378 25283 raft_consensus.cc:1261] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Refusing update from remote peer 5890caff42af46d8aa3578a4d1f02877: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:50.216922 25518 consensus_queue.cc:1035] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:50.217440 25558 consensus_queue.cc:1035] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:50.227104 25519 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: TxnStatusTablet state changed. Reason: New leader 5890caff42af46d8aa3578a4d1f02877. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.227459 25519 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.230171 25558 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.230510 25558 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:50.232367 25528 mvcc.cc:205] Tried to move back new op lower bound from 7317142938476687360 to 7317142938269986816. Current Snapshot: MvccSnapshot[applied={T|T < 7317142938476687360 or (T in {7317142938476687360})}]
I20260811 01:30:50.236277 25526 mvcc.cc:205] Tried to move back new op lower bound from 7317142938476687360 to 7317142938269986816. Current Snapshot: MvccSnapshot[applied={T|T < 7317142938476687360}]
I20260811 01:30:50.236193 25519 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.236630 25519 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P f9ffada7cc144aa08e8f0f8d4b783a86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.239306 25520 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: TxnStatusTablet state changed. Reason: New leader 5890caff42af46d8aa3578a4d1f02877. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.239630 25520 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.245719 25518 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.246042 25518 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P 5890caff42af46d8aa3578a4d1f02877: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:50.249794 25520 tablet_replica.cc:439] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5890caff42af46d8aa3578a4d1f02877" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 } } peers { permanent_uuid: "f9ffada7cc144aa08e8f0f8d4b783a86" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46525 } } peers { permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 } } }
I20260811 01:30:50.250058 25520 tablet_replica.cc:442] T f551648b9db6419f9b5615098af29e78 P c3e39b811e9a46eaae2653c3e5c7567a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:50.270640 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.262678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:58131 (local address 127.23.39.193:36209)
0811 01:30:50.262957 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.262964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.263136 (+ 172us) server_negotiation.cc:407] Connection header received
0811 01:30:50.263545 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.263552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.263653 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.263775 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:50.264591 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.265859 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.268216 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.268936 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.269088 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.269699 (+ 611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.269856 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.270019 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.270198 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.270297 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 01:30:50.271013 25567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.261942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:36209 (local address 127.23.39.194:58131)
0811 01:30:50.263008 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:50.263028 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:50.263305 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:50.263800 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:50.263806 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:50.263819 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:50.264334 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.264350 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.266021 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.266027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.268039 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.268054 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.269153 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.269160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.269390 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.269468 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.270017 (+ 549us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.270039 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.270150 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.270303 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"thread_start_us":1018,"threads_started":1}
I20260811 01:30:50.285660 25441 raft_consensus.cc:1261] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Refusing update from remote peer f9ffada7cc144aa08e8f0f8d4b783a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:50.286494 25531 consensus_queue.cc:1035] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e39b811e9a46eaae2653c3e5c7567a" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:50.293735 25132 raft_consensus.cc:1261] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Refusing update from remote peer f9ffada7cc144aa08e8f0f8d4b783a86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:50.294539 25531 consensus_queue.cc:1035] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5890caff42af46d8aa3578a4d1f02877" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:50.308542 25527 mvcc.cc:205] Tried to move back new op lower bound from 7317142938760691712 to 7317142937399930880. Current Snapshot: MvccSnapshot[applied={T|T < 7317142938760691712}]
I20260811 01:30:50.374936 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.357262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:56507 (local address 127.23.39.194:46525)
0811 01:30:50.357507 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.357514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.366979 (+ 9465us) server_negotiation.cc:407] Connection header received
0811 01:30:50.367320 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.367326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.367418 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.367513 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:50.368505 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.369655 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.372503 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.373186 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.373298 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.374007 (+ 709us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.374206 (+ 199us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.374308 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.374480 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.374584 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:30:50.375286 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.357583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46525 (local address 127.23.39.193:56507)
0811 01:30:50.366840 (+ 9257us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:50.366863 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:50.367048 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:50.367725 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:50.367730 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:50.367744 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:50.368315 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.368329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.369839 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.369844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.372321 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:50.372337 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.373495 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.373501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:50.373684 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.373773 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:50.374328 (+ 555us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:50.374343 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 01:30:50.374436 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 01:30:50.374600 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8997,"thread_start_us":8783,"threads_started":1}
I20260811 01:30:50.457643 24958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:50.457983 24958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:50.461687 24958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9723478e85d24a499b3453a71f5ef3da: Sending DeleteTablet for 3 replicas of tablet b8a45c5c4e2247cb9e17fab33b3971f9
I20260811 01:30:50.462801 25262 tablet_service.cc:1514] Processing DeleteTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:50 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:56646
I20260811 01:30:50.463001 25415 tablet_service.cc:1514] Processing DeleteTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:50 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:53980
I20260811 01:30:50.463948 25110 tablet_service.cc:1514] Processing DeleteTablet for tablet b8a45c5c4e2247cb9e17fab33b3971f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:50 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:52512
I20260811 01:30:50.478603 25582 tablet_replica.cc:330] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: stopping tablet replica
I20260811 01:30:50.478956 25582 raft_consensus.cc:2229] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:50.479372 25582 raft_consensus.cc:2258] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:50.481304 25582 ts_tablet_manager.cc:1905] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:50.486361 25584 tablet_replica.cc:330] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: stopping tablet replica
I20260811 01:30:50.486704 25584 raft_consensus.cc:2229] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:50.487107 25584 raft_consensus.cc:2258] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:50.488442 25584 ts_tablet_manager.cc:1905] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:50.488965 25581 tablet_replica.cc:330] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: stopping tablet replica
I20260811 01:30:50.489334 25581 raft_consensus.cc:2229] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:30:50.490669 25581 raft_consensus.cc:2258] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:50.492654 25581 ts_tablet_manager.cc:1905] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:50.499161 25582 ts_tablet_manager.cc:1918] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:50.499373 25582 log.cc:1196] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/b8a45c5c4e2247cb9e17fab33b3971f9
I20260811 01:30:50.499967 25582 ts_tablet_manager.cc:1939] T b8a45c5c4e2247cb9e17fab33b3971f9 P c3e39b811e9a46eaae2653c3e5c7567a: Deleting consensus metadata
I20260811 01:30:50.501370 24943 catalog_manager.cc:4841] TS c3e39b811e9a46eaae2653c3e5c7567a (127.23.39.195:41185): tablet b8a45c5c4e2247cb9e17fab33b3971f9 (table test-table [id=485cbb2f29254c9e955cd2d3716f5064]) successfully deleted
I20260811 01:30:50.504895 25584 ts_tablet_manager.cc:1918] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:50.505050 25584 log.cc:1196] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/b8a45c5c4e2247cb9e17fab33b3971f9
I20260811 01:30:50.505630 25584 ts_tablet_manager.cc:1939] T b8a45c5c4e2247cb9e17fab33b3971f9 P 5890caff42af46d8aa3578a4d1f02877: Deleting consensus metadata
I20260811 01:30:50.506925 24945 catalog_manager.cc:4841] TS 5890caff42af46d8aa3578a4d1f02877 (127.23.39.193:36209): tablet b8a45c5c4e2247cb9e17fab33b3971f9 (table test-table [id=485cbb2f29254c9e955cd2d3716f5064]) successfully deleted
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:30:50.510700 25581 ts_tablet_manager.cc:1918] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:50.510849 25581 log.cc:1196] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/b8a45c5c4e2247cb9e17fab33b3971f9
I20260811 01:30:50.511343 25581 ts_tablet_manager.cc:1939] T b8a45c5c4e2247cb9e17fab33b3971f9 P f9ffada7cc144aa08e8f0f8d4b783a86: Deleting consensus metadata
I20260811 01:30:50.512504 24944 catalog_manager.cc:4841] TS f9ffada7cc144aa08e8f0f8d4b783a86 (127.23.39.194:46525): tablet b8a45c5c4e2247cb9e17fab33b3971f9 (table test-table [id=485cbb2f29254c9e955cd2d3716f5064]) successfully deleted
I20260811 01:30:50.519469 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.477613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.23.39.193:36209)
0811 01:30:50.477821 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.477828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.488383 (+ 10555us) server_negotiation.cc:407] Connection header received
0811 01:30:50.488899 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.488906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.488991 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.489063 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:50.492596 (+ 3533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.493894 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.502835 (+ 8941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.503681 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.503808 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.510679 (+ 6871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.510694 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.510721 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.510789 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.515588 (+ 4799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.516630 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.516640 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.516646 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.516854 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.517326 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.517332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.517335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.517834 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.518258 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.518545 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.518830 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 01:30:50.520608 25181 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52524
I20260811 01:30:50.550985 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.523964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57942 (local address 127.23.39.254:45687)
0811 01:30:50.534668 (+ 10704us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.534674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.534698 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:30:50.534762 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.534766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.534840 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.534960 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:50.537299 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.538341 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.540309 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.540764 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.540889 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.544461 (+ 3572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.544466 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.544469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.544513 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.547548 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.548614 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.548618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.548620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.548765 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.549282 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.549287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.549289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.549655 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.549877 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.550388 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.550612 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10566,"thread_start_us":10442,"threads_started":1}
W20260811 01:30:50.551867 24958 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57942
I20260811 01:30:50.554872 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25034
I20260811 01:30:50.570768 25506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.555833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52530 (local address 127.23.39.193:36209)
0811 01:30:50.556055 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.556062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.556380 (+ 318us) server_negotiation.cc:407] Connection header received
0811 01:30:50.556493 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.556499 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.556613 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.556753 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:50.558111 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.559102 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.560475 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.560988 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.561138 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.563946 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.563952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.563955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.564001 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.567400 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.568322 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.568328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.568332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.568539 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.568969 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.568978 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.568982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.569372 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.569663 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.570032 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.570393 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:30:50.571441 25181 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52530
W20260811 01:30:50.572141 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25034: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:30:50.572353 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25034
I20260811 01:30:50.598121 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25191
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:30:50.613719 25510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.599116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56656 (local address 127.23.39.194:46525)
0811 01:30:50.599302 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.599306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.599324 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:30:50.599485 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.599489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.599566 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.599650 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:50.600841 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.601553 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.602960 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.603431 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.603543 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.608019 (+ 4476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.608036 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.608053 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.608097 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.611085 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.611813 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.611820 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.611823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.611971 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.612317 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.612320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.612322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.612699 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.612975 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.613255 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.613443 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 01:30:50.614512 25333 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56656
W20260811 01:30:50.615168 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25191: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:30:50.615335 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25191
I20260811 01:30:50.643743 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25343
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[24910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411849, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:30:50.661641 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:50.644612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.23.39.195:41185)
0811 01:30:50.645117 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:50.645122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:50.645140 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:30:50.645200 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:50.645205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:50.645279 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:50.645387 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:50.646814 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.647536 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.648804 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:50.649280 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:50.649389 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:50.654047 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:50.654066 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:50.654082 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:50.654240 (+ 158us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:50.657835 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.658826 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.658841 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.658846 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.659056 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:50.659625 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:50.659631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:50.659635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:50.660174 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:50.660535 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:50.660925 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 01:30:50.661265 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":293,"threads_started":1}
W20260811 01:30:50.662662 25487 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53986
W20260811 01:30:50.663503 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25343: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:30:50.663693 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25343
I20260811 01:30:50.687305 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 24925
I20260811 01:30:50.688580 25001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:30:50.810779 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 24925
2026-08-11T01:30:50Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4960 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[25596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[25596](info): set up 2 sockets
Aug 11 01:30:50 dist-test-slave-9jjr krb5kdc[25596](info): commencing operation
krb5kdc: starting...
W20260811 01:30:51.975991 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:30:52 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:30:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:30:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:30:52.219255 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:35873
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:35873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:52.567152 25610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:52.567533 25610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:52.567710 25610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:52.575240 25610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:30:52.575400 25610 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:30:52.575510 25610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:52.575626 25610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:52.575721 25610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:30:52.575814 25610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:30:52.586309 25610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:35873
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:35873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:52.587742 25610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:52.589123 25610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:52.601707 25615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:52.601837 25618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:52.601871 25616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:52.602689 25610 server_base.cc:1034] running on GCE node
I20260811 01:30:52.603555 25610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:52.605031 25610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:52.606253 25610 hybrid_clock.cc:648] HybridClock initialized: now 1786411852606183 us; error 35 us; skew 500 ppm
I20260811 01:30:52.606604 25610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:52 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411852, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:52.609922 25610 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:30:52.611660 25610 webserver.cc:460] Webserver started at http://127.23.39.254:40673/ using document root <none> and password file <none>
I20260811 01:30:52.612422 25610 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:52.612560 25610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:52.612910 25610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:52.616539 25610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d"
format_stamp: "Formatted at 2026-08-11 01:30:52 on dist-test-slave-9jjr"
server_key: "7e4a703bb240ff5d991ba061f1ffd406"
server_key_iv: "aad85b34269b7b1a42bc6861b44e2cc0"
server_key_version: "encryptionkey@0"
I20260811 01:30:52.617499 25610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d"
format_stamp: "Formatted at 2026-08-11 01:30:52 on dist-test-slave-9jjr"
server_key: "7e4a703bb240ff5d991ba061f1ffd406"
server_key_iv: "aad85b34269b7b1a42bc6861b44e2cc0"
server_key_version: "encryptionkey@0"
I20260811 01:30:52.623463 25610 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:30:52.627403 25625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:52.628882 25610 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260811 01:30:52.629118 25610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d"
format_stamp: "Formatted at 2026-08-11 01:30:52 on dist-test-slave-9jjr"
server_key: "7e4a703bb240ff5d991ba061f1ffd406"
server_key_iv: "aad85b34269b7b1a42bc6861b44e2cc0"
server_key_version: "encryptionkey@0"
I20260811 01:30:52.629410 25610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:52.651743 25610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:52.656751 25610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:52.657114 25610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:52.683718 25610 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:35873
I20260811 01:30:52.683732 25691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:35873 every 8 connection(s)
I20260811 01:30:52.685250 25610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:30:52.689181 25692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:52.695231 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25610
I20260811 01:30:52.695468 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:30:52.696343 23711 external_mini_cluster.cc:1428] Setting key 54605a11986ad577b3318a4bdbd5fe2c
I20260811 01:30:52.701248 25692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Bootstrap starting.
I20260811 01:30:52.705222 25692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:52.706595 25692 log.cc:824] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:52.710338 25692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: No bootstrap required, opened a new log
Aug 11 01:30:52 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:52.719120 25692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } }
I20260811 01:30:52.719584 25692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:52.719740 25692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1014fa8d4c8e45dd9ed5ffa9b65f388d, State: Initialized, Role: FOLLOWER
I20260811 01:30:52.720500 25692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } }
I20260811 01:30:52.720815 25692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:30:52.720964 25692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:30:52.721179 25692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:52.722116 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:52.698706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.23.39.254:35873)
0811 01:30:52.699588 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:52.699601 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:52.699648 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:30:52.701401 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:52.701439 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:52.701842 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:52.702236 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:52.704152 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:52.705500 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:52.707398 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:52.708392 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:52.708538 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:52.713527 (+ 4989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:52.713535 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:52.713554 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:52.713603 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:52.716997 (+ 3394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:52.717816 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:52.717828 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:52.717835 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:52.718023 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:52.718476 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:52.718480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:52.718482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:52.719082 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:52.719438 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:52.719960 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 01:30:52.720467 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":439,"threads_started":1}
I20260811 01:30:52.724192 25692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } }
I20260811 01:30:52.724767 25692 leader_election.cc:302] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1014fa8d4c8e45dd9ed5ffa9b65f388d; no voters:
I20260811 01:30:52.725487 25692 leader_election.cc:288] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:30:52.725590 25697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:52.726480 25697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [term 1 LEADER]: Becoming Leader. State: Replica: 1014fa8d4c8e45dd9ed5ffa9b65f388d, State: Running, Role: LEADER
I20260811 01:30:52.727181 25697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } }
I20260811 01:30:52.728008 25692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:30:52.730595 25700 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1014fa8d4c8e45dd9ed5ffa9b65f388d. Latest consensus state: current_term: 1 leader_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } } }
I20260811 01:30:52.730628 25699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014fa8d4c8e45dd9ed5ffa9b65f388d" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 35873 } } }
I20260811 01:30:52.731040 25700 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:52.731097 25699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d [sys.catalog]: This master's current role is: LEADER
I20260811 01:30:52.735013 25707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:30:52.741814 25707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:30:52.752192 25707 catalog_manager.cc:1347] Generated new cluster ID: 3a5313a7a6864704bde210dbe813a01b
I20260811 01:30:52.752338 25707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:30:52.772625 25707 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:30:52.774196 25707 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:30:52.789744 25707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Generated new TSK 0
I20260811 01:30:52.790843 25707 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:30:52.866813 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:35873
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:53.225323 25722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:53.225644 25722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:53.225816 25722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:53.233912 25722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:53.234099 25722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:53.234297 25722 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:30:53.234385 25722 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:53.234496 25722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:30:53.245142 25722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:35873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:53.246690 25722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:53.248086 25722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:53.262303 25728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:53.262362 25729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:53.262562 25731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:53.267769 25722 server_base.cc:1034] running on GCE node
I20260811 01:30:53.268529 25722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:53.269620 25722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:53.270869 25722 hybrid_clock.cc:648] HybridClock initialized: now 1786411853270825 us; error 50 us; skew 500 ppm
I20260811 01:30:53.271230 25722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:53 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:53.274595 25722 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:30:53.276291 25722 webserver.cc:460] Webserver started at http://127.23.39.193:40637/ using document root <none> and password file <none>
I20260811 01:30:53.277000 25722 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:53.277110 25722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:53.277384 25722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:53.280529 25722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "452a16294ec24e18806b693aa727f0b1"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "df525d5ea537179e93e1700d8272f99e"
server_key_iv: "96786aaa964d6c29077a5acd527bcfc6"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.281299 25722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "452a16294ec24e18806b693aa727f0b1"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "df525d5ea537179e93e1700d8272f99e"
server_key_iv: "96786aaa964d6c29077a5acd527bcfc6"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.287072 25722 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:30:53.290621 25740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:53.292059 25722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:30:53.292256 25722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "452a16294ec24e18806b693aa727f0b1"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "df525d5ea537179e93e1700d8272f99e"
server_key_iv: "96786aaa964d6c29077a5acd527bcfc6"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.292482 25722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:53.309248 25722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:53.314232 25722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:53.314570 25722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:53.317456 25722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:53.317656 25722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:53.317798 25722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:53.317894 25722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:30:53 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:53.351251 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.318536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:49447 (local address 127.23.39.254:35873)
0811 01:30:53.324503 (+ 5967us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:53.324511 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:53.326231 (+ 1720us) server_negotiation.cc:407] Connection header received
0811 01:30:53.329122 (+ 2891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:53.329129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:53.329229 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:53.329350 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:53.332549 (+ 3199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.333391 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.337355 (+ 3964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.337978 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.338207 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.342501 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:53.342506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:53.342510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:53.342549 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:53.346759 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.348018 (+ 1259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.348025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.348029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.348243 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.348951 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.348955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.348957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.349252 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:53.349381 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:53.350716 (+ 1335us) server_negotiation.cc:299] Negotiation successful
0811 01:30:53.350974 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5789,"thread_start_us":5651,"threads_started":1}
I20260811 01:30:53.354208 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.319366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.193:49447)
0811 01:30:53.325210 (+ 5844us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:53.325296 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:53.328557 (+ 3261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:53.330015 (+ 1458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:53.330032 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:53.331091 (+ 1059us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:53.332289 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.332326 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.333606 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.333615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.336958 (+ 3343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.336985 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.338398 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.338408 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.338646 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.339610 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:53.339636 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:53.342182 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:53.346991 (+ 4809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.347008 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.347034 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.347845 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.348407 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.348416 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.348422 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.348792 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.349418 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:53.349432 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:53.350119 (+ 687us) client_negotiation.cc:769] Sending connection context
0811 01:30:53.350567 (+ 448us) client_negotiation.cc:240] Negotiation successful
0811 01:30:53.352036 (+ 1469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5553,"thread_start_us":5336,"threads_started":1}
I20260811 01:30:53.374423 25722 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:43009
I20260811 01:30:53.374490 25869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:43009 every 8 connection(s)
I20260811 01:30:53.375952 25722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:30:53.378329 25870 heartbeater.cc:347] Connected to a master server at 127.23.39.254:35873
I20260811 01:30:53.378612 25870 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:53.379369 25870 heartbeater.cc:511] Master 127.23.39.254:35873 requested a full tablet report, sending...
I20260811 01:30:53.380427 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.361357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:49525 (local address 127.23.39.254:35873)
0811 01:30:53.361696 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:53.361706 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:53.362820 (+ 1114us) server_negotiation.cc:407] Connection header received
0811 01:30:53.362963 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:53.362971 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:53.363094 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:53.363230 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:53.365205 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.366090 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.368961 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.369828 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.369963 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.373173 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:53.373180 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:53.373184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:53.373228 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:53.376720 (+ 3492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.377874 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.377881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.377884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.378287 (+ 403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.378778 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.378783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.378792 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.379099 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:53.379282 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:53.379752 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 01:30:53.380017 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 01:30:53.381593 25643 ts_manager.cc:194] Registered new tserver with Master: 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009)
I20260811 01:30:53.380510 25839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.361878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.193:49525)
0811 01:30:53.362681 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:53.362707 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:53.362845 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:53.363464 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:53.363472 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:53.364479 (+ 1007us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:53.365018 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.365034 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.366314 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.366323 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.368687 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.368732 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.370433 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.370447 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.370720 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.371615 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:53.371650 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:53.372885 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:53.376917 (+ 4032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.376927 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.376935 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.377704 (+ 769us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.378436 (+ 732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.378439 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.378442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.378632 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.379242 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:53.379248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:53.379457 (+ 209us) client_negotiation.cc:769] Sending connection context
0811 01:30:53.379644 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 01:30:53.380037 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":423,"threads_started":1}
I20260811 01:30:53.383432 25643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:49447
I20260811 01:30:53.385598 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25722
I20260811 01:30:53.385842 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:30:53.386672 23711 external_mini_cluster.cc:1428] Setting key f57877748f1d3db4b9cb5a27a858d3b4
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:30:53.440101 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:35873
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:53.797010 25875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:53.797391 25875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:53.797606 25875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:53.805297 25875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:53.805480 25875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:53.805635 25875 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:30:53.805729 25875 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:53.805869 25875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:30:53.816419 25875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:35873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:53.817945 25875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:53.819443 25875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:53.834975 25883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:53.834947 25882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:53.835052 25885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:53.835858 25875 server_base.cc:1034] running on GCE node
I20260811 01:30:53.836566 25875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:53.837721 25875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:53.838956 25875 hybrid_clock.cc:648] HybridClock initialized: now 1786411853838905 us; error 49 us; skew 500 ppm
I20260811 01:30:53.839392 25875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:53 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:53.843257 25875 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:30:53.844935 25875 webserver.cc:460] Webserver started at http://127.23.39.194:32943/ using document root <none> and password file <none>
I20260811 01:30:53.845690 25875 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:53.845841 25875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:53.846289 25875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:53.849594 25875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "815a98819f8b4830ab5675f1e98b1cd3"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "521d99fb5f4faa97f3648cf356442542"
server_key_iv: "0486c751f87d36d7cd814e3e84d94390"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.850695 25875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "815a98819f8b4830ab5675f1e98b1cd3"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "521d99fb5f4faa97f3648cf356442542"
server_key_iv: "0486c751f87d36d7cd814e3e84d94390"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.856577 25875 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 01:30:53.860689 25893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:53.862393 25875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:30:53.862608 25875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "815a98819f8b4830ab5675f1e98b1cd3"
format_stamp: "Formatted at 2026-08-11 01:30:53 on dist-test-slave-9jjr"
server_key: "521d99fb5f4faa97f3648cf356442542"
server_key_iv: "0486c751f87d36d7cd814e3e84d94390"
server_key_version: "encryptionkey@0"
I20260811 01:30:53.862869 25875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:53.882917 25875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:53.888331 25875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:53.888712 25875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:53.891914 25875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:53.892063 25875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:53.892205 25875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:53.892307 25875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:30:53 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411853, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:53.919848 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.892661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56417 (local address 127.23.39.254:35873)
0811 01:30:53.895724 (+ 3063us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:53.895732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:53.895762 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:30:53.898082 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:53.898091 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:53.898248 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:53.898343 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:53.901200 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.902334 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.905102 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.905787 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.905945 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.911435 (+ 5490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:53.911444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:53.911452 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:53.911511 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:53.915627 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.916741 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.916746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.916748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.916917 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.917737 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.917744 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.917750 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.918167 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:53.918360 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:53.919144 (+ 784us) server_negotiation.cc:299] Negotiation successful
0811 01:30:53.919411 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2894,"thread_start_us":2763,"threads_started":1}
I20260811 01:30:53.920961 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.893496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.194:56417)
0811 01:30:53.894817 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:53.894893 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:53.897652 (+ 2759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:53.898965 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:53.898981 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:53.899896 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:53.900891 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.900923 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.902557 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.902561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.904927 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.904941 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.906065 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.906074 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.906420 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.907477 (+ 1057us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:53.907507 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:53.911117 (+ 3610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:53.915835 (+ 4718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.915844 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.915860 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.916532 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.917130 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.917144 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.917148 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.917555 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.918340 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:53.918349 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:53.918760 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 01:30:53.919056 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 01:30:53.919670 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":504,"threads_started":1}
I20260811 01:30:53.950390 25875 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:36793
I20260811 01:30:53.950414 26026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:36793 every 8 connection(s)
I20260811 01:30:53.951993 25875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:30:53.953480 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.928714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:38585 (local address 127.23.39.254:35873)
0811 01:30:53.928890 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:53.928895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:53.938984 (+ 10089us) server_negotiation.cc:407] Connection header received
0811 01:30:53.939241 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:53.939249 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:53.939327 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:53.939444 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:53.940592 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.941357 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.943110 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.943786 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.943936 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.946731 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:53.946736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:53.946740 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:53.946776 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:53.950260 (+ 3484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.951128 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.951134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.951138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.951284 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:53.951683 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:53.951689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:53.951692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:53.952183 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:53.952369 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:53.952833 (+ 464us) server_negotiation.cc:299] Negotiation successful
0811 01:30:53.953108 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 01:30:53.953658 25975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:53.928712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.194:38585)
0811 01:30:53.938839 (+ 10127us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:53.938862 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:53.939070 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:53.939537 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:53.939542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:53.940114 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:53.940422 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.940432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.941523 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.941529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.942855 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:53.942878 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:53.944015 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:53.944028 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:53.944204 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:53.945049 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:53.945106 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:53.946447 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:53.950414 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.950420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.950424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.950988 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.951405 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:53.951410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:53.951414 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:53.951556 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:53.952328 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:53.952338 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:53.952564 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 01:30:53.952729 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 01:30:53.953150 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9895,"thread_start_us":9636,"threads_started":1}
I20260811 01:30:53.954936 26027 heartbeater.cc:347] Connected to a master server at 127.23.39.254:35873
I20260811 01:30:53.955338 26027 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:53.955559 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 25875
I20260811 01:30:53.955760 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:30:53.956292 23711 external_mini_cluster.cc:1428] Setting key 7837b3d1756580bdd94ea6d97c6e0f68
I20260811 01:30:53.956346 26027 heartbeater.cc:511] Master 127.23.39.254:35873 requested a full tablet report, sending...
I20260811 01:30:53.958316 25641 ts_manager.cc:194] Registered new tserver with Master: 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:53.959497 25641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:56417
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:30:54.010902 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:35873
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:30:54.362059 26031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:30:54.362502 26031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:30:54.362673 26031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:30:54.370507 26031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:30:54.370646 26031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:30:54.370793 26031 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 01:30:54.370877 26031 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:30:54.371013 26031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:30:54.384174 26031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:35873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:30:54.385571 26031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:30:54.386745 25870 heartbeater.cc:503] Master 127.23.39.254:35873 was elected leader, sending a full tablet report...
I20260811 01:30:54.387194 26031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:30:54.401216 26037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:54.401170 26040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:30:54.401748 26038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:30:54.402760 26031 server_base.cc:1034] running on GCE node
I20260811 01:30:54.403507 26031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:30:54.404510 26031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:30:54.405752 26031 hybrid_clock.cc:648] HybridClock initialized: now 1786411854405712 us; error 50 us; skew 500 ppm
I20260811 01:30:54.406090 26031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:30:54 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411854, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:30:54.409304 26031 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:30:54.410920 26031 webserver.cc:460] Webserver started at http://127.23.39.195:46749/ using document root <none> and password file <none>
I20260811 01:30:54.411633 26031 fs_manager.cc:359] Metadata directory not provided
I20260811 01:30:54.411796 26031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:30:54.412132 26031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:30:54.415306 26031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "ea924b9ce0384030ae70df1ccea3de42"
format_stamp: "Formatted at 2026-08-11 01:30:54 on dist-test-slave-9jjr"
server_key: "8e71b67797f9bda0075d2abc99c852ed"
server_key_iv: "a87b7b5d780fccf2111a97a9fd09249a"
server_key_version: "encryptionkey@0"
I20260811 01:30:54.416123 26031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "ea924b9ce0384030ae70df1ccea3de42"
format_stamp: "Formatted at 2026-08-11 01:30:54 on dist-test-slave-9jjr"
server_key: "8e71b67797f9bda0075d2abc99c852ed"
server_key_iv: "a87b7b5d780fccf2111a97a9fd09249a"
server_key_version: "encryptionkey@0"
I20260811 01:30:54.422814 26031 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:30:54.426934 26048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:54.428535 26031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:30:54.428818 26031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "ea924b9ce0384030ae70df1ccea3de42"
format_stamp: "Formatted at 2026-08-11 01:30:54 on dist-test-slave-9jjr"
server_key: "8e71b67797f9bda0075d2abc99c852ed"
server_key_iv: "a87b7b5d780fccf2111a97a9fd09249a"
server_key_version: "encryptionkey@0"
I20260811 01:30:54.429095 26031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:30:54.449508 26031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:30:54.454277 26031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:30:54.454619 26031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:30:54.457561 26031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:30:54.457773 26031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:30:54.457912 26031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:30:54.458003 26031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:30:54 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411854, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:54.488492 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.459827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:59495 (local address 127.23.39.254:35873)
0811 01:30:54.466588 (+ 6761us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.466596 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.466623 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:30:54.466760 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.466768 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.466916 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.467062 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:54.470424 (+ 3362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.471897 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.474808 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.475444 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.475598 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.480812 (+ 5214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:54.480818 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:54.480821 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:54.480860 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:54.484392 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.485302 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.485311 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.485316 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.485519 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.486045 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.486050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.486054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.486424 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:54.486594 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.487803 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.488065 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6582,"thread_start_us":6474,"threads_started":1}
I20260811 01:30:54.490015 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.459239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.195:59495)
0811 01:30:54.460253 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.460323 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.463617 (+ 3294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.467482 (+ 3865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.467497 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.468705 (+ 1208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:54.470025 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.470071 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.472103 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.472112 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.474604 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.474620 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.475787 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.475799 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.476227 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.477292 (+ 1065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:54.477333 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:54.480503 (+ 3170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:54.484586 (+ 4083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:54.484597 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:54.484618 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:54.485137 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:54.485676 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:54.485685 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:54.485688 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:54.485900 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:54.486578 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:54.486587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:54.487083 (+ 496us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.487696 (+ 613us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.488485 (+ 789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":589,"threads_started":1}
I20260811 01:30:54.517094 26133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.499111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.23.39.195:44029)
0811 01:30:54.500420 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.500449 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.500667 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.501075 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.501083 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.501934 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:54.503188 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.503217 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.505180 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.505189 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.507412 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.507439 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.508471 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.508479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.508724 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.509661 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:54.509678 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:54.510637 (+ 959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:54.514183 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:54.514189 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:54.514193 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:54.514695 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:54.515242 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:54.515246 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:54.515248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:54.515423 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:54.516172 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:54.516176 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:54.516343 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.516473 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.516754 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"thread_start_us":788,"threads_started":1}
I20260811 01:30:54.517540 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.499146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:44029 (local address 127.23.39.254:35873)
0811 01:30:54.499415 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.499425 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.500580 (+ 1155us) server_negotiation.cc:407] Connection header received
0811 01:30:54.500809 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.500813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.500889 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.500984 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:54.503429 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.504967 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.507686 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.508222 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.508401 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.510862 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:54.510870 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:54.510880 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:54.510914 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:54.513989 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.514876 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.514884 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.514887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.515087 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.515549 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.515557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.515563 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.516015 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:54.516196 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.516658 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.516993 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:30:54.526032 26031 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:37235
I20260811 01:30:54.526057 26178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:37235 every 8 connection(s)
I20260811 01:30:54.527468 26031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:30:54.530340 26180 heartbeater.cc:347] Connected to a master server at 127.23.39.254:35873
I20260811 01:30:54.530638 26180 heartbeater.cc:464] Registering TS with master...
I20260811 01:30:54.531445 26180 heartbeater.cc:511] Master 127.23.39.254:35873 requested a full tablet report, sending...
I20260811 01:30:54.532934 25641 ts_manager.cc:194] Registered new tserver with Master: ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235)
I20260811 01:30:54.533890 25641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:59495
I20260811 01:30:54.536624 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26031
I20260811 01:30:54.536775 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:30:54.537161 23711 external_mini_cluster.cc:1428] Setting key a45b9c5dbdd3978a2d770096b3e278c7
I20260811 01:30:54.540774 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:30:54 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:30:54 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:54.659874 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.639814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.23.39.254:35873)
0811 01:30:54.640027 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.640035 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.640859 (+ 824us) server_negotiation.cc:407] Connection header received
0811 01:30:54.641169 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.641178 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.641312 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.641395 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:54.644109 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.645350 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.647533 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.648305 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.648436 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.653389 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:54.653394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:54.653398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:54.653469 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:54.656788 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.657673 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.657678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.657682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.657841 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:54.658340 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:54.658344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:54.658346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:54.658639 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:54.658938 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.659274 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.659514 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:30:54.665623 25641 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:54.673605 25641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:54.724884 26195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.687816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.0.0.1:38700)
0811 01:30:54.710902 (+ 23086us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.710967 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.711258 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.715771 (+ 4513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.715781 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.715848 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:54.716470 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.716489 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.719017 (+ 2528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.719024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.721379 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.721391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.723541 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.723550 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.723828 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.723882 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.724023 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.724260 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22679,"mutex_wait_us":1,"thread_start_us":22478,"threads_started":1}
I20260811 01:30:54.725844 26197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.688441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38700 (local address 127.23.39.193:43009)
0811 01:30:54.714756 (+ 26315us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.714771 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.714824 (+ 53us) server_negotiation.cc:407] Connection header received
0811 01:30:54.714976 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.714990 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.715378 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.716790 (+ 1412us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:54.717094 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.718852 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.721567 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.723232 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.723420 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.725258 (+ 1838us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.725345 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.725534 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26074,"thread_start_us":25907,"threads_started":1}
I20260811 01:30:54.726969 26198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.688865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49106 (local address 127.23.39.194:36793)
0811 01:30:54.718197 (+ 29332us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.718209 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.718246 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:30:54.718368 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.718376 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.718685 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.718945 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:54.720049 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.721598 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.724333 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.725790 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.725964 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.726217 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.726496 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.726666 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29095,"thread_start_us":28900,"threads_started":1}
I20260811 01:30:54.726969 26200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.688058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:36793 (local address 127.0.0.1:49106)
0811 01:30:54.717325 (+ 29267us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.717353 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.717515 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.719193 (+ 1678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.719203 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.719234 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:54.719802 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.719818 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.721749 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.721755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.724128 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.724144 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.726029 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.726035 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.726260 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.726317 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.726416 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.726561 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29105,"mutex_wait_us":71,"thread_start_us":30186,"threads_started":1}
I20260811 01:30:54.727125 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.690485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:37235 (local address 127.0.0.1:50908)
0811 01:30:54.718522 (+ 28037us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.718542 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.718666 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.719607 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.719618 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.719649 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:54.720155 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.720168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.722193 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.722199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.724142 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.724156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.726319 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.726324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.726507 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.726535 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.726604 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.726735 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27914,"mutex_wait_us":54,"thread_start_us":26544,"threads_started":1}
I20260811 01:30:54.729722 26201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.691128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.23.39.195:37235)
0811 01:30:54.716805 (+ 25677us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.716818 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.718681 (+ 1863us) server_negotiation.cc:407] Connection header received
0811 01:30:54.718808 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.718815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.719037 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.719252 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:54.720436 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.722010 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.724342 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.725841 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.726007 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.728773 (+ 2766us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.728861 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.729369 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25413,"thread_start_us":23321,"threads_started":1}
I20260811 01:30:54.730028 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 9a020c332e6d46c194a2516734256fe6 (DEFAULT_TABLE table=test-table [id=e8984766d9094492907e451905424e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:54.730759 25946 tablet_service.cc:1467] Processing CreateTablet for tablet 9a020c332e6d46c194a2516734256fe6 (DEFAULT_TABLE table=test-table [id=e8984766d9094492907e451905424e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:54.731738 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a020c332e6d46c194a2516734256fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:54.732220 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a020c332e6d46c194a2516734256fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:54.734026 26104 tablet_service.cc:1467] Processing CreateTablet for tablet 9a020c332e6d46c194a2516734256fe6 (DEFAULT_TABLE table=test-table [id=e8984766d9094492907e451905424e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:54.736093 26104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a020c332e6d46c194a2516734256fe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:54.751180 26202 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Bootstrap starting.
I20260811 01:30:54.752442 26203 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Bootstrap starting.
I20260811 01:30:54.754384 26204 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Bootstrap starting.
I20260811 01:30:54.756572 26203 tablet_bootstrap.cc:654] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:54.757649 26202 tablet_bootstrap.cc:654] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:54.757706 26204 tablet_bootstrap.cc:654] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:54.758270 26203 log.cc:824] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:54.759087 26204 log.cc:824] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:54.759119 26202 log.cc:824] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Log is configured to *not* fsync() on all Append() calls
I20260811 01:30:54.761937 26203 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: No bootstrap required, opened a new log
I20260811 01:30:54.762249 26204 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: No bootstrap required, opened a new log
I20260811 01:30:54.762338 26203 ts_tablet_manager.cc:1397] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20260811 01:30:54.762534 26204 ts_tablet_manager.cc:1397] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260811 01:30:54.763159 26202 tablet_bootstrap.cc:492] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: No bootstrap required, opened a new log
I20260811 01:30:54.763443 26202 ts_tablet_manager.cc:1397] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s
I20260811 01:30:54.771452 26203 raft_consensus.cc:348] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.771930 26203 raft_consensus.cc:374] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:54.772069 26203 raft_consensus.cc:729] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Initialized, Role: FOLLOWER
I20260811 01:30:54.772763 26203 consensus_queue.cc:260] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.773936 26027 heartbeater.cc:503] Master 127.23.39.254:35873 was elected leader, sending a full tablet report...
I20260811 01:30:54.774051 26204 raft_consensus.cc:348] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.774628 26204 raft_consensus.cc:374] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:54.774420 26202 raft_consensus.cc:348] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.774847 26204 raft_consensus.cc:729] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Initialized, Role: FOLLOWER
I20260811 01:30:54.774887 26202 raft_consensus.cc:374] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:54.774983 26202 raft_consensus.cc:729] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Initialized, Role: FOLLOWER
I20260811 01:30:54.775596 26203 ts_tablet_manager.cc:1428] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260811 01:30:54.775736 26202 consensus_queue.cc:260] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.775946 26204 consensus_queue.cc:260] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.777177 26180 heartbeater.cc:503] Master 127.23.39.254:35873 was elected leader, sending a full tablet report...
I20260811 01:30:54.778196 26204 ts_tablet_manager.cc:1428] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Time spent starting tablet: real 0.016s user 0.015s sys 0.001s
W20260811 01:30:54.779299 26181 tablet.cc:2369] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:54.781056 26202 ts_tablet_manager.cc:1428] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
W20260811 01:30:54.879585 25871 tablet.cc:2369] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:30:54.955758 26028 tablet.cc:2369] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:30:54.966609 26210 raft_consensus.cc:482] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:54.966987 26210 raft_consensus.cc:504] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:54.968966 26210 leader_election.cc:288] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:54.975243 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.969178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.23.39.195:52157)
0811 01:30:54.969509 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.969552 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.969701 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.970226 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.970231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.970263 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:54.970477 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.970487 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.971636 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.971641 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.973061 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.973080 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.974382 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.974389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.974609 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.974637 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.974762 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.974917 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
I20260811 01:30:54.975220 26197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.969448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:52157 (local address 127.23.39.193:43009)
0811 01:30:54.969671 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.969679 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.969709 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:30:54.969933 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.969940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.970034 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.970184 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:54.970649 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.971453 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.973253 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.974208 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.974397 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.974485 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.974792 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.974937 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:30:54.975854 26198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.969668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:39811 (local address 127.23.39.194:36793)
0811 01:30:54.969892 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:54.969899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:54.970640 (+ 741us) server_negotiation.cc:407] Connection header received
0811 01:30:54.970854 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:54.970857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:54.970916 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:54.971012 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:54.971576 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.972352 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.973996 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.974866 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.975059 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.975142 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:54.975519 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 01:30:54.975652 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:30:54.976583 26211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:54.969451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:36793 (local address 127.23.39.195:39811)
0811 01:30:54.970528 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:54.970542 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:54.970713 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:54.971042 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:54.971047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:54.971073 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:54.971423 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.971431 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.972491 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.972498 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.973842 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:54.973854 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:54.975124 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:54.975130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:54.975288 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:54.975344 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:30:54.976093 (+ 749us) client_negotiation.cc:240] Negotiation successful
0811 01:30:54.976259 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"thread_start_us":469,"threads_started":1}
I20260811 01:30:54.976492 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a020c332e6d46c194a2516734256fe6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1" is_pre_election: true
I20260811 01:30:54.977073 25819 raft_consensus.cc:2454] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:54.977769 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a020c332e6d46c194a2516734256fe6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3" is_pre_election: true
I20260811 01:30:54.977873 26052 leader_election.cc:302] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:54.978283 25973 raft_consensus.cc:2454] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:54.978317 26210 raft_consensus.cc:2781] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:54.978470 26210 raft_consensus.cc:482] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:54.978608 26210 raft_consensus.cc:3037] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.050362 26210 raft_consensus.cc:504] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.051218 26210 leader_election.cc:288] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Requested vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:55.051905 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a020c332e6d46c194a2516734256fe6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1"
I20260811 01:30:55.052045 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a020c332e6d46c194a2516734256fe6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3"
I20260811 01:30:55.052223 25819 raft_consensus.cc:3037] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.052418 25973 raft_consensus.cc:3037] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.148301 25819 raft_consensus.cc:2454] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:55.148301 25973 raft_consensus.cc:2454] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:55.149114 26051 leader_election.cc:302] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, 815a98819f8b4830ab5675f1e98b1cd3, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:55.149523 26210 raft_consensus.cc:2781] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:55.150033 26210 raft_consensus.cc:686] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Becoming Leader. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Running, Role: LEADER
I20260811 01:30:55.150704 26210 consensus_queue.cc:237] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.156280 25641 catalog_manager.cc:5495] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "ea924b9ce0384030ae70df1ccea3de42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } health_report { overall_health: HEALTHY } } }
Aug 11 01:30:55 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411852, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:55.219772 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.197424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:35873 (local address 127.0.0.1:52780)
0811 01:30:55.198114 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.198189 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.198384 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.198737 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.198742 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.199634 (+ 892us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:30:55.199910 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.199920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.201174 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.201178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.202310 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.202323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.203172 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.203177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.203333 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.211269 (+ 7936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:30:55.211292 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:30:55.213927 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:30:55.217209 (+ 3282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:55.217224 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:55.217230 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:55.217793 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:55.218190 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:30:55.218198 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:30:55.218204 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:30:55.218364 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:30:55.218884 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:30:55.218891 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:30:55.219048 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.219179 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.219417 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":406,"threads_started":1}
I20260811 01:30:55.219882 26219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.196834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52780 (local address 127.23.39.254:35873)
0811 01:30:55.197507 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.197511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.198292 (+ 781us) server_negotiation.cc:407] Connection header received
0811 01:30:55.198525 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.198528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.198595 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.198710 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:55.200111 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.200996 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.202546 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.202986 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.203159 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.214281 (+ 11122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:55.214287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:55.214290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:55.214326 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:55.217046 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:55.217918 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:55.217922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:55.217925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:55.218050 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:55.218473 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:55.218476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:55.218478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:55.218765 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:55.218881 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.219301 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.219571 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":517,"thread_start_us":320,"threads_started":1}
I20260811 01:30:55.225281 25641 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:52780:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:30:55.226689 25641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:55.240736 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9a408cba0640a089832626df005544 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ddce7e3db88c44a48b4e2625653f3fdc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:55.240887 25946 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9a408cba0640a089832626df005544 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ddce7e3db88c44a48b4e2625653f3fdc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:55.241185 26104 tablet_service.cc:1467] Processing CreateTablet for tablet 8b9a408cba0640a089832626df005544 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ddce7e3db88c44a48b4e2625653f3fdc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:30:55.241976 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9a408cba0640a089832626df005544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.242013 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9a408cba0640a089832626df005544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.242012 26104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b9a408cba0640a089832626df005544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.251145 26203 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: Bootstrap starting.
I20260811 01:30:55.251571 26202 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: Bootstrap starting.
I20260811 01:30:55.253249 26203 tablet_bootstrap.cc:654] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.253284 26202 tablet_bootstrap.cc:654] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.256142 26203 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: No bootstrap required, opened a new log
I20260811 01:30:55.256367 26203 ts_tablet_manager.cc:1397] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260811 01:30:55.257301 26203 raft_consensus.cc:348] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.257639 26203 raft_consensus.cc:374] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.257784 26203 raft_consensus.cc:729] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.258054 26203 consensus_queue.cc:260] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.258664 26208 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.259073 26208 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.260249 26203 ts_tablet_manager.cc:1428] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 01:30:55.264817 26204 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: Bootstrap starting.
I20260811 01:30:55.266558 26204 tablet_bootstrap.cc:654] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.271836 26202 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: No bootstrap required, opened a new log
I20260811 01:30:55.272068 26202 ts_tablet_manager.cc:1397] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.006s
I20260811 01:30:55.273273 26202 raft_consensus.cc:348] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.273613 26204 tablet_bootstrap.cc:492] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: No bootstrap required, opened a new log
I20260811 01:30:55.273707 26202 raft_consensus.cc:374] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.273844 26204 ts_tablet_manager.cc:1397] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260811 01:30:55.273839 26202 raft_consensus.cc:729] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.274211 26202 consensus_queue.cc:260] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.274758 26204 raft_consensus.cc:348] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.275058 26204 raft_consensus.cc:374] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.274788 26209 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.275264 26209 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.275257 26204 raft_consensus.cc:729] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.275636 26204 consensus_queue.cc:260] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.275849 26202 ts_tablet_manager.cc:1428] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 01:30:55.276134 26210 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.276464 26210 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.277058 26204 ts_tablet_manager.cc:1428] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:30:55.424717 26209 raft_consensus.cc:482] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:55.425058 26209 raft_consensus.cc:504] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.427404 26209 leader_election.cc:288] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793), ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235)
I20260811 01:30:55.445998 26198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.428590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:53669 (local address 127.23.39.194:36793)
0811 01:30:55.428826 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.428836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.438547 (+ 9711us) server_negotiation.cc:407] Connection header received
0811 01:30:55.438751 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.438760 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.438868 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.439002 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:55.440177 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.441325 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.443453 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.444429 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.444922 (+ 493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.445014 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.445511 (+ 497us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.445674 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:30:55.446244 26224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.428014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:36793 (local address 127.23.39.193:53669)
0811 01:30:55.438376 (+ 10362us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.438399 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.438566 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.439233 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.439240 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.439280 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:55.439967 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.439984 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.441467 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.441476 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.443240 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.443281 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.445004 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.445013 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.445266 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.445322 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.445445 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.445652 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10204,"mutex_wait_us":89,"thread_start_us":9515,"threads_started":1}
I20260811 01:30:55.446760 26226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.427883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:37235 (local address 127.23.39.193:45583)
0811 01:30:55.437079 (+ 9196us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.437115 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.437383 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.439034 (+ 1651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.439039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.439066 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:55.439661 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.439675 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.441194 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.441202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.444035 (+ 2833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.444056 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.445808 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.445816 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.446006 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.446050 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.446193 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.446328 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8960,"mutex_wait_us":34,"thread_start_us":10081,"threads_started":1}
I20260811 01:30:55.447222 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9a408cba0640a089832626df005544" candidate_uuid: "452a16294ec24e18806b693aa727f0b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3" is_pre_election: true
I20260811 01:30:55.447459 26225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.428007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:45583 (local address 127.23.39.195:37235)
0811 01:30:55.438737 (+ 10730us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.438742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.438760 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:30:55.438820 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.438823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.438882 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.439009 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:55.439848 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.441009 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.444242 (+ 3233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.445365 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.445563 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.445631 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.447051 (+ 1420us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.447202 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10498,"thread_start_us":10327,"threads_started":1}
I20260811 01:30:55.447556 25973 raft_consensus.cc:2454] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452a16294ec24e18806b693aa727f0b1 in term 0.
I20260811 01:30:55.448264 25742 leader_election.cc:302] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, 815a98819f8b4830ab5675f1e98b1cd3; no voters:
I20260811 01:30:55.448379 26129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9a408cba0640a089832626df005544" candidate_uuid: "452a16294ec24e18806b693aa727f0b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea924b9ce0384030ae70df1ccea3de42" is_pre_election: true
I20260811 01:30:55.448828 26209 raft_consensus.cc:2781] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:55.448807 26129 raft_consensus.cc:2454] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 452a16294ec24e18806b693aa727f0b1 in term 0.
I20260811 01:30:55.448969 26209 raft_consensus.cc:482] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:55.449069 26209 raft_consensus.cc:3037] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.454787 26209 raft_consensus.cc:504] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.455977 26209 leader_election.cc:288] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [CANDIDATE]: Term 1 election: Requested vote from peers 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793), ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235)
I20260811 01:30:55.456501 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9a408cba0640a089832626df005544" candidate_uuid: "452a16294ec24e18806b693aa727f0b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3"
I20260811 01:30:55.456817 25973 raft_consensus.cc:3037] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.461084 26129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b9a408cba0640a089832626df005544" candidate_uuid: "452a16294ec24e18806b693aa727f0b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea924b9ce0384030ae70df1ccea3de42"
I20260811 01:30:55.461361 26129 raft_consensus.cc:3037] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.559875 25973 raft_consensus.cc:2454] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452a16294ec24e18806b693aa727f0b1 in term 1.
I20260811 01:30:55.559942 26129 raft_consensus.cc:2454] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 452a16294ec24e18806b693aa727f0b1 in term 1.
I20260811 01:30:55.560739 25741 leader_election.cc:302] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, 815a98819f8b4830ab5675f1e98b1cd3, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:55.561153 26209 raft_consensus.cc:2781] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:55.561656 26209 raft_consensus.cc:686] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [term 1 LEADER]: Becoming Leader. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Running, Role: LEADER
I20260811 01:30:55.562273 26209 consensus_queue.cc:237] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.567727 26227 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: TxnStatusTablet state changed. Reason: New leader 452a16294ec24e18806b693aa727f0b1. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.568073 26227 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:55.568876 26229 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:30:55.569283 26229 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:30:55.569775 25641 catalog_manager.cc:5495] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 452a16294ec24e18806b693aa727f0b1 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } health_report { overall_health: UNKNOWN } } }
I20260811 01:30:55.581308 26210 consensus_queue.cc:1035] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:55.589561 26210 consensus_queue.cc:1035] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:55.646678 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.633868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.23.39.193:43009)
0811 01:30:55.639424 (+ 5556us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.639429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.639466 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:30:55.639581 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.639584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.639677 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.639914 (+ 237us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:55.640474 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.641397 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.643589 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.644107 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.644225 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.644865 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.645891 (+ 1026us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.646011 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.646262 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.646349 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5422,"thread_start_us":5196,"threads_started":1}
I20260811 01:30:55.646763 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.633629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.0.0.1:38706)
0811 01:30:55.633924 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.633947 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.634173 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.639971 (+ 5798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.639979 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.639996 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:55.640282 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.640298 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.641580 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.641587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.643376 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.643399 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.644306 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.644313 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.644514 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.644620 (+ 106us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.646028 (+ 1408us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.646062 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.646221 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.646419 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 01:30:55.655892 25973 raft_consensus.cc:1261] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Refusing update from remote peer 452a16294ec24e18806b693aa727f0b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:55.656061 26129 raft_consensus.cc:1261] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Refusing update from remote peer 452a16294ec24e18806b693aa727f0b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:55.656809 26227 consensus_queue.cc:1035] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:55.657232 26209 consensus_queue.cc:1035] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:55.670766 26208 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: TxnStatusTablet state changed. Reason: New leader 452a16294ec24e18806b693aa727f0b1. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.671149 26208 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.673659 26209 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.674047 26209 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:55.674504 26238 mvcc.cc:205] Tried to move back new op lower bound from 7317142960754917376 to 7317142960387411968. Current Snapshot: MvccSnapshot[applied={T|T < 7317142960754917376}]
I20260811 01:30:55.689289 26208 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.689683 26208 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 815a98819f8b4830ab5675f1e98b1cd3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.695529 26212 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: TxnStatusTablet state changed. Reason: New leader 452a16294ec24e18806b693aa727f0b1. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.695896 26212 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.699025 26227 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.699342 26227 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P 452a16294ec24e18806b693aa727f0b1: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:30:55.713375 26212 tablet_replica.cc:439] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "452a16294ec24e18806b693aa727f0b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } } }
I20260811 01:30:55.713711 26212 tablet_replica.cc:442] T 8b9a408cba0640a089832626df005544 P ea924b9ce0384030ae70df1ccea3de42: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:30:55.716787 26225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.698113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.23.39.195:37235)
0811 01:30:55.698330 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.698336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.702564 (+ 4228us) server_negotiation.cc:407] Connection header received
0811 01:30:55.703044 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.703053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.703231 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.703404 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:55.704830 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.706357 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.709426 (+ 3069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.710419 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.710561 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.711552 (+ 991us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.712664 (+ 1112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.712826 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.715742 (+ 2916us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.716308 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:30:55.737995 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.730791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.23.39.195:38219)
0811 01:30:55.731437 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.731456 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.731607 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.731983 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.731986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.731996 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:55.732317 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.732325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.733912 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.733917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.735254 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.735277 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.736392 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.736396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.736571 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.736646 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.737478 (+ 832us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.737488 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.737558 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.737679 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":424,"threads_started":1}
I20260811 01:30:55.737999 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.730977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:38219 (local address 127.23.39.193:43009)
0811 01:30:55.731194 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.731201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.731563 (+ 362us) server_negotiation.cc:407] Connection header received
0811 01:30:55.731744 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.731749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.731851 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.731957 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:55.732532 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.733741 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.735445 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.736190 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.736335 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.736856 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.737022 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.737466 (+ 444us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.737613 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.737702 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:30:55.791227 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.782497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:37235 (local address 127.23.39.193:33627)
0811 01:30:55.783288 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.783310 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.783552 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.784027 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.784034 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.784052 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:55.784548 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.784576 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.786468 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.786477 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.788365 (+ 1888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.788387 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.789582 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.789591 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.789791 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.789861 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.790531 (+ 670us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.790545 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.790621 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.790773 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":772,"threads_started":1}
I20260811 01:30:55.791836 26225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.783007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:33627 (local address 127.23.39.195:37235)
0811 01:30:55.783251 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.783259 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.783399 (+ 140us) server_negotiation.cc:407] Connection header received
0811 01:30:55.783739 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.783748 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.783872 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.783998 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:55.784779 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.786277 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.788577 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.789371 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.789531 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.790108 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:55.790374 (+ 266us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:55.790472 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.791569 (+ 1097us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.791648 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:30:55.839540 25641 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:55.839895 25641 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:55.844626 25641 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Sending DeleteTablet for 3 replicas of tablet 9a020c332e6d46c194a2516734256fe6
I20260811 01:30:55.846355 26104 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a020c332e6d46c194a2516734256fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:55 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:50908
I20260811 01:30:55.846530 25946 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a020c332e6d46c194a2516734256fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:55 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:49106
I20260811 01:30:55.847908 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a020c332e6d46c194a2516734256fe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:55 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:38700
I20260811 01:30:55.850967 25641 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:55.853260 25641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:55.854820 26260 tablet_replica.cc:330] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: stopping tablet replica
I20260811 01:30:55.861863 26259 tablet_replica.cc:330] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: stopping tablet replica
I20260811 01:30:55.862689 26259 raft_consensus.cc:2229] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:55.862668 26260 raft_consensus.cc:2229] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:55.863185 26259 raft_consensus.cc:2258] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:55.863191 26260 raft_consensus.cc:2258] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:55.865507 26260 ts_tablet_manager.cc:1905] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:55.865978 25946 tablet_service.cc:1467] Processing CreateTablet for tablet 0370dee3bc034b14a823c08580b45402 (DEFAULT_TABLE table=test-table [id=de7b2058e8034ad98f095baabbb6c798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:55.866657 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0370dee3bc034b14a823c08580b45402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.866591 26103 tablet_service.cc:1467] Processing CreateTablet for tablet 0370dee3bc034b14a823c08580b45402 (DEFAULT_TABLE table=test-table [id=de7b2058e8034ad98f095baabbb6c798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:55.867128 26103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0370dee3bc034b14a823c08580b45402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.865537 26259 ts_tablet_manager.cc:1905] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:55.874842 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 0370dee3bc034b14a823c08580b45402 (DEFAULT_TABLE table=test-table [id=de7b2058e8034ad98f095baabbb6c798]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:55.875451 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0370dee3bc034b14a823c08580b45402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:55.877187 26263 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Bootstrap starting.
I20260811 01:30:55.879311 26263 tablet_bootstrap.cc:654] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.879771 26262 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Bootstrap starting.
I20260811 01:30:55.883424 26262 tablet_bootstrap.cc:654] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.888614 26263 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: No bootstrap required, opened a new log
I20260811 01:30:55.888953 26263 ts_tablet_manager.cc:1397] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260811 01:30:55.889941 26258 tablet_replica.cc:330] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: stopping tablet replica
I20260811 01:30:55.890229 26263 raft_consensus.cc:348] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.890759 26263 raft_consensus.cc:374] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.890933 26263 raft_consensus.cc:729] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.891337 26263 consensus_queue.cc:260] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.892513 26262 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: No bootstrap required, opened a new log
I20260811 01:30:55.892762 26262 ts_tablet_manager.cc:1397] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260811 01:30:55.892972 26263 ts_tablet_manager.cc:1428] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 01:30:55.893751 26262 raft_consensus.cc:348] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.894088 26262 raft_consensus.cc:374] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.894260 26262 raft_consensus.cc:729] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.894595 26262 consensus_queue.cc:260] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.895357 26262 ts_tablet_manager.cc:1428] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 01:30:55.892539 26258 raft_consensus.cc:2229] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:30:55.897156 26258 raft_consensus.cc:2258] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:55.901751 26266 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Bootstrap starting.
I20260811 01:30:55.904923 26258 ts_tablet_manager.cc:1905] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:55.905678 26266 tablet_bootstrap.cc:654] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:55.912828 26266 tablet_bootstrap.cc:492] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: No bootstrap required, opened a new log
I20260811 01:30:55.913056 26266 ts_tablet_manager.cc:1397] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260811 01:30:55.913882 26208 raft_consensus.cc:482] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:55.914083 26266 raft_consensus.cc:348] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.914184 26208 raft_consensus.cc:504] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.914431 26266 raft_consensus.cc:374] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:55.914548 26266 raft_consensus.cc:729] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Initialized, Role: FOLLOWER
I20260811 01:30:55.914870 26266 consensus_queue.cc:260] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.915599 26266 ts_tablet_manager.cc:1428] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 01:30:55.916255 26208 leader_election.cc:288] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235)
I20260811 01:30:55.929252 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.920388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:58735 (local address 127.23.39.193:43009)
0811 01:30:55.920596 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.920603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.920627 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:30:55.920758 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.920763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.920864 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.920975 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:55.921783 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.923122 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.925997 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.927761 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.927968 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.928068 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.928761 (+ 693us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.928935 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:30:55.931969 26268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.917136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.23.39.194:58735)
0811 01:30:55.917988 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.918012 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.918205 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.921187 (+ 2982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.921192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.921220 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:55.921557 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.921572 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.923346 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.923352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.925790 (+ 2438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.925810 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.928300 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.928308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.928532 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.928569 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.931382 (+ 2813us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.931571 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":4502,"threads_started":1}
I20260811 01:30:55.933372 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0370dee3bc034b14a823c08580b45402" candidate_uuid: "815a98819f8b4830ab5675f1e98b1cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1" is_pre_election: true
I20260811 01:30:55.933739 25819 raft_consensus.cc:2454] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815a98819f8b4830ab5675f1e98b1cd3 in term 0.
I20260811 01:30:55.934091 26225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.920636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:44401 (local address 127.23.39.195:37235)
0811 01:30:55.920870 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:55.920876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:55.920899 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:30:55.920983 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:55.920988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:55.921064 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:55.921173 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:30:55.926029 (+ 4856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.927309 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.930539 (+ 3230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.932065 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.932219 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.932315 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:55.933512 (+ 1197us) server_negotiation.cc:299] Negotiation successful
0811 01:30:55.933699 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260811 01:30:55.934716 25896 leader_election.cc:302] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, 815a98819f8b4830ab5675f1e98b1cd3; no voters:
I20260811 01:30:55.935216 26208 raft_consensus.cc:2781] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:55.935348 26208 raft_consensus.cc:482] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:55.935442 26208 raft_consensus.cc:3037] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.938508 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:55.917800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:37235 (local address 127.23.39.194:44401)
0811 01:30:55.918703 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:55.918724 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:55.918834 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:55.925248 (+ 6414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:55.925253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:55.925287 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:30:55.925790 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.925805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.927549 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.927556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.930296 (+ 2740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:55.930314 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:55.933040 (+ 2726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:55.933048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:55.933271 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:55.933314 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:30:55.934611 (+ 1297us) client_negotiation.cc:240] Negotiation successful
0811 01:30:55.934813 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"thread_start_us":7100,"threads_started":1}
I20260811 01:30:55.939678 26129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0370dee3bc034b14a823c08580b45402" candidate_uuid: "815a98819f8b4830ab5675f1e98b1cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea924b9ce0384030ae70df1ccea3de42" is_pre_election: true
I20260811 01:30:55.939982 26129 raft_consensus.cc:2454] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815a98819f8b4830ab5675f1e98b1cd3 in term 0.
I20260811 01:30:55.975467 26208 raft_consensus.cc:504] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:55.976298 26208 leader_election.cc:288] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235)
I20260811 01:30:55.977289 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0370dee3bc034b14a823c08580b45402" candidate_uuid: "815a98819f8b4830ab5675f1e98b1cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1"
I20260811 01:30:55.977556 25819 raft_consensus.cc:3037] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:55.978104 26259 ts_tablet_manager.cc:1918] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:55.978364 26259 log.cc:1196] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/9a020c332e6d46c194a2516734256fe6
I20260811 01:30:55.979161 26259 ts_tablet_manager.cc:1939] T 9a020c332e6d46c194a2516734256fe6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting consensus metadata
I20260811 01:30:55.982455 26129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0370dee3bc034b14a823c08580b45402" candidate_uuid: "815a98819f8b4830ab5675f1e98b1cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea924b9ce0384030ae70df1ccea3de42"
I20260811 01:30:55.982717 26129 raft_consensus.cc:3037] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:56.048292 25627 catalog_manager.cc:4841] TS 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793): tablet 9a020c332e6d46c194a2516734256fe6 (table test-table [id=e8984766d9094492907e451905424e2b]) successfully deleted
I20260811 01:30:56.075002 26258 ts_tablet_manager.cc:1918] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:56.075259 26258 log.cc:1196] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/9a020c332e6d46c194a2516734256fe6
I20260811 01:30:56.075873 26258 ts_tablet_manager.cc:1939] T 9a020c332e6d46c194a2516734256fe6 P ea924b9ce0384030ae70df1ccea3de42: Deleting consensus metadata
I20260811 01:30:56.076391 25819 raft_consensus.cc:2454] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815a98819f8b4830ab5675f1e98b1cd3 in term 1.
I20260811 01:30:56.077102 25896 leader_election.cc:302] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, 815a98819f8b4830ab5675f1e98b1cd3; no voters:
I20260811 01:30:56.077495 26208 raft_consensus.cc:2781] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:56.081789 26260 ts_tablet_manager.cc:1918] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:56.084203 25626 catalog_manager.cc:4841] TS ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235): tablet 9a020c332e6d46c194a2516734256fe6 (table test-table [id=e8984766d9094492907e451905424e2b]) successfully deleted
I20260811 01:30:56.084827 26260 log.cc:1196] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/9a020c332e6d46c194a2516734256fe6
I20260811 01:30:56.085119 26129 raft_consensus.cc:2454] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815a98819f8b4830ab5675f1e98b1cd3 in term 1.
I20260811 01:30:56.085879 26260 ts_tablet_manager.cc:1939] T 9a020c332e6d46c194a2516734256fe6 P 452a16294ec24e18806b693aa727f0b1: Deleting consensus metadata
I20260811 01:30:56.087260 26208 raft_consensus.cc:686] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 LEADER]: Becoming Leader. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Running, Role: LEADER
I20260811 01:30:56.087886 26208 consensus_queue.cc:237] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:56.092159 25643 catalog_manager.cc:5495] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "815a98819f8b4830ab5675f1e98b1cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } health_report { overall_health: UNKNOWN } } }
I20260811 01:30:56.161470 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:56.154266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49108 (local address 127.23.39.194:36793)
0811 01:30:56.154893 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:56.154897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:56.154918 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:30:56.155150 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:56.155154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:56.155233 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:56.155397 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:56.155842 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.156658 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.158995 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.159468 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.159569 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:56.160136 (+ 567us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:56.160736 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:56.160849 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:56.161011 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 01:30:56.161087 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":370,"threads_started":1}
I20260811 01:30:56.178483 25628 catalog_manager.cc:4841] TS 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009): tablet 9a020c332e6d46c194a2516734256fe6 (table test-table [id=e8984766d9094492907e451905424e2b]) successfully deleted
I20260811 01:30:56.179311 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:56.172721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:47655 (local address 127.23.39.193:43009)
0811 01:30:56.172941 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:56.172947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:56.173364 (+ 417us) server_negotiation.cc:407] Connection header received
0811 01:30:56.173534 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:56.173540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:56.173645 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:56.173768 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:56.174325 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.175480 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.176883 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.177443 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.177581 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:56.178366 (+ 785us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:56.178547 (+ 181us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:56.178613 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:56.178841 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:30:56.178945 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 01:30:56.180183 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:56.172565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43009 (local address 127.23.39.194:47655)
0811 01:30:56.173255 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:56.173273 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:56.173399 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:56.173801 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:56.173804 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:56.173814 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:56.174103 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:56.174111 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.175638 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.175642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:56.176720 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:56.176733 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.177760 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.177767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:56.178010 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:56.178115 (+ 105us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:56.178697 (+ 582us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:56.178711 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 01:30:56.179509 (+ 798us) client_negotiation.cc:240] Negotiation successful
0811 01:30:56.179703 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":356,"threads_started":1}
I20260811 01:30:56.190842 26129 raft_consensus.cc:1261] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Refusing update from remote peer 815a98819f8b4830ab5675f1e98b1cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:56.190991 25819 raft_consensus.cc:1261] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Refusing update from remote peer 815a98819f8b4830ab5675f1e98b1cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:56.191609 26270 consensus_queue.cc:1035] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:56.192226 26208 consensus_queue.cc:1035] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:56.226989 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:56.220587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:36793 (local address 127.23.39.193:44215)
0811 01:30:56.220801 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 01:30:56.220824 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:30:56.220940 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:30:56.221515 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:30:56.221520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:30:56.221532 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:30:56.221749 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:56.221773 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.223302 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.223307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:56.224775 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:30:56.224792 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.225753 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.225759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:30:56.225941 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:56.225994 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:30:56.226496 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:30:56.226508 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:30:56.226597 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:30:56.226758 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 01:30:56.227083 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:56.220633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:44215 (local address 127.23.39.194:36793)
0811 01:30:56.221216 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:56.221223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:56.221241 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:30:56.221316 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:56.221320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:56.221409 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:56.221502 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:56.221942 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.223131 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.224947 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:56.225606 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:56.225754 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:56.226213 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:56.226353 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:56.226441 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:56.226658 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 01:30:56.226770 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464}
W20260811 01:30:56.228528 26238 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:30:57.851171 25641 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:57.851401 25641 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52774:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:57.855844 25641 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Sending DeleteTablet for 3 replicas of tablet 0370dee3bc034b14a823c08580b45402
I20260811 01:30:57.856902 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 0370dee3bc034b14a823c08580b45402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:57 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:38700
I20260811 01:30:57.856906 25946 tablet_service.cc:1514] Processing DeleteTablet for tablet 0370dee3bc034b14a823c08580b45402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:57 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:49106
I20260811 01:30:57.856985 26103 tablet_service.cc:1514] Processing DeleteTablet for tablet 0370dee3bc034b14a823c08580b45402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:57 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:50908
I20260811 01:30:57.867218 26305 tablet_replica.cc:330] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: stopping tablet replica
I20260811 01:30:57.867638 26305 raft_consensus.cc:2229] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:57.868090 26305 raft_consensus.cc:2258] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:57.869436 26306 tablet_replica.cc:330] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: stopping tablet replica
I20260811 01:30:57.869575 26305 ts_tablet_manager.cc:1905] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:57.869876 26306 raft_consensus.cc:2229] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:30:57.870157 26307 tablet_replica.cc:330] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: stopping tablet replica
I20260811 01:30:57.870503 26307 raft_consensus.cc:2229] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:57.870586 26306 raft_consensus.cc:2258] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:57.870852 26307 raft_consensus.cc:2258] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:57.871891 26307 ts_tablet_manager.cc:1905] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:57.872107 26306 ts_tablet_manager.cc:1905] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:57.876816 26305 ts_tablet_manager.cc:1918] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:30:57.877046 26305 log.cc:1196] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/0370dee3bc034b14a823c08580b45402
I20260811 01:30:57.877624 26305 ts_tablet_manager.cc:1939] T 0370dee3bc034b14a823c08580b45402 P 452a16294ec24e18806b693aa727f0b1: Deleting consensus metadata
I20260811 01:30:57.879330 26306 ts_tablet_manager.cc:1918] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:30:57.879478 25628 catalog_manager.cc:4841] TS 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009): tablet 0370dee3bc034b14a823c08580b45402 (table test-table [id=de7b2058e8034ad98f095baabbb6c798]) successfully deleted
I20260811 01:30:57.879573 26306 log.cc:1196] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/0370dee3bc034b14a823c08580b45402
I20260811 01:30:57.879863 26307 ts_tablet_manager.cc:1918] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:30:57.880067 26307 log.cc:1196] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/0370dee3bc034b14a823c08580b45402
I20260811 01:30:57.880328 26306 ts_tablet_manager.cc:1939] T 0370dee3bc034b14a823c08580b45402 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting consensus metadata
I20260811 01:30:57.880591 26307 ts_tablet_manager.cc:1939] T 0370dee3bc034b14a823c08580b45402 P ea924b9ce0384030ae70df1ccea3de42: Deleting consensus metadata
I20260811 01:30:57.881454 25627 catalog_manager.cc:4841] TS 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793): tablet 0370dee3bc034b14a823c08580b45402 (table test-table [id=de7b2058e8034ad98f095baabbb6c798]) successfully deleted
I20260811 01:30:57.881824 25626 catalog_manager.cc:4841] TS ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235): tablet 0370dee3bc034b14a823c08580b45402 (table test-table [id=de7b2058e8034ad98f095baabbb6c798]) successfully deleted
Aug 11 01:30:57 dist-test-slave-9jjr krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:30:57 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:30:57.924134 26316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:57.908569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.23.39.254:35873)
0811 01:30:57.909508 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:57.909512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:57.909535 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:30:57.909592 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:57.909595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:57.909662 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:57.909759 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:30:57.911342 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:57.912143 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:57.913385 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:57.913845 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:57.913939 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:57.918376 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:30:57.918382 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:30:57.918385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:30:57.918424 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:30:57.921330 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:57.922031 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:57.922036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:57.922039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:57.922250 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:30:57.922583 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:30:57.922586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:30:57.922588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:30:57.922957 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:30:57.923204 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:57.923542 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 01:30:57.923749 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":619,"threads_started":1}
I20260811 01:30:57.928273 25641 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:57.929123 25641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:57.937016 25794 tablet_service.cc:1467] Processing CreateTablet for tablet aa8ecd43436043a298589526792473b6 (DEFAULT_TABLE table=test-table [id=6319cf1a18b248399469bbeb28e00e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:57.937261 26103 tablet_service.cc:1467] Processing CreateTablet for tablet aa8ecd43436043a298589526792473b6 (DEFAULT_TABLE table=test-table [id=6319cf1a18b248399469bbeb28e00e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:57.937268 25946 tablet_service.cc:1467] Processing CreateTablet for tablet aa8ecd43436043a298589526792473b6 (DEFAULT_TABLE table=test-table [id=6319cf1a18b248399469bbeb28e00e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:57.937566 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8ecd43436043a298589526792473b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:57.937712 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8ecd43436043a298589526792473b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:57.937747 26103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8ecd43436043a298589526792473b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:57.943113 26317 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Bootstrap starting.
I20260811 01:30:57.945004 26318 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Bootstrap starting.
I20260811 01:30:57.946283 26317 tablet_bootstrap.cc:654] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:57.947052 26318 tablet_bootstrap.cc:654] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:57.950238 26317 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: No bootstrap required, opened a new log
I20260811 01:30:57.950596 26317 ts_tablet_manager.cc:1397] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 01:30:57.951757 26317 raft_consensus.cc:348] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.952303 26317 raft_consensus.cc:374] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:57.952507 26317 raft_consensus.cc:729] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Initialized, Role: FOLLOWER
I20260811 01:30:57.952705 26319 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Bootstrap starting.
I20260811 01:30:57.952965 26317 consensus_queue.cc:260] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.953825 26317 ts_tablet_manager.cc:1428] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 01:30:57.955791 26318 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: No bootstrap required, opened a new log
I20260811 01:30:57.956039 26318 ts_tablet_manager.cc:1397] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260811 01:30:57.956697 26319 tablet_bootstrap.cc:654] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:57.957026 26318 raft_consensus.cc:348] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.957384 26318 raft_consensus.cc:374] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:57.957584 26318 raft_consensus.cc:729] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Initialized, Role: FOLLOWER
I20260811 01:30:57.957974 26318 consensus_queue.cc:260] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.959976 26318 ts_tablet_manager.cc:1428] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:30:57.961416 26319 tablet_bootstrap.cc:492] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: No bootstrap required, opened a new log
I20260811 01:30:57.961628 26319 ts_tablet_manager.cc:1397] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260811 01:30:57.962551 26319 raft_consensus.cc:348] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.962836 26319 raft_consensus.cc:374] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:57.962951 26319 raft_consensus.cc:729] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Initialized, Role: FOLLOWER
I20260811 01:30:57.963342 26319 consensus_queue.cc:260] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:57.963989 26319 ts_tablet_manager.cc:1428] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 01:30:58.117818 26324 raft_consensus.cc:482] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:58.118161 26324 raft_consensus.cc:504] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.118990 26324 leader_election.cc:288] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:58.119619 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8ecd43436043a298589526792473b6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3" is_pre_election: true
I20260811 01:30:58.119619 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8ecd43436043a298589526792473b6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1" is_pre_election: true
I20260811 01:30:58.119928 25819 raft_consensus.cc:2454] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:58.119908 25973 raft_consensus.cc:2454] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:58.120464 26052 leader_election.cc:302] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:58.120784 26324 raft_consensus.cc:2781] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:58.120950 26324 raft_consensus.cc:482] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:58.121068 26324 raft_consensus.cc:3037] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.123380 26324 raft_consensus.cc:504] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.124059 26324 leader_election.cc:288] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Requested vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:58.124639 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8ecd43436043a298589526792473b6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1"
I20260811 01:30:58.124641 25973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8ecd43436043a298589526792473b6" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3"
I20260811 01:30:58.124910 25819 raft_consensus.cc:3037] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.124922 25973 raft_consensus.cc:3037] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.128175 25819 raft_consensus.cc:2454] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:58.128175 25973 raft_consensus.cc:2454] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:58.128774 26052 leader_election.cc:302] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 452a16294ec24e18806b693aa727f0b1, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:58.129272 26324 raft_consensus.cc:2781] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:58.129822 26324 raft_consensus.cc:686] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Becoming Leader. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Running, Role: LEADER
I20260811 01:30:58.130205 26324 consensus_queue.cc:237] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.133239 25643 catalog_manager.cc:5495] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "ea924b9ce0384030ae70df1ccea3de42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } health_report { overall_health: HEALTHY } } }
I20260811 01:30:58.165553 26328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:30:58.160322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36368 (local address 127.23.39.195:37235)
0811 01:30:58.160979 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 01:30:58.160983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:30:58.161002 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:30:58.161057 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:30:58.161061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:30:58.161122 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:30:58.161205 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:30:58.161589 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:58.162434 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:58.163778 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:30:58.164182 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:30:58.164282 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:30:58.164736 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:30:58.164843 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:30:58.164912 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:30:58.165041 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 01:30:58.165105 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":387,"threads_started":1}
I20260811 01:30:58.175659 25973 raft_consensus.cc:1261] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Refusing update from remote peer ea924b9ce0384030ae70df1ccea3de42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:58.175724 25819 raft_consensus.cc:1261] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Refusing update from remote peer ea924b9ce0384030ae70df1ccea3de42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:58.176266 26325 consensus_queue.cc:1035] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:58.176649 26324 consensus_queue.cc:1035] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:58.226598 25641 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:58.226897 25641 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:30:58.230098 25641 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Sending DeleteTablet for 3 replicas of tablet aa8ecd43436043a298589526792473b6
I20260811 01:30:58.231172 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8ecd43436043a298589526792473b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:58 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:38700
I20260811 01:30:58.231212 25946 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8ecd43436043a298589526792473b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:58 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:49106
I20260811 01:30:58.231491 26305 tablet_replica.cc:330] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: stopping tablet replica
I20260811 01:30:58.231580 26103 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8ecd43436043a298589526792473b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:30:58 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:50908
I20260811 01:30:58.231670 26306 tablet_replica.cc:330] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: stopping tablet replica
I20260811 01:30:58.231693 26305 raft_consensus.cc:2229] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:58.231874 26306 raft_consensus.cc:2229] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:30:58.231920 26305 raft_consensus.cc:2258] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:58.231926 26307 tablet_replica.cc:330] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: stopping tablet replica
I20260811 01:30:58.232079 26306 raft_consensus.cc:2258] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:58.232158 26307 raft_consensus.cc:2229] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:30:58.232573 26307 raft_consensus.cc:2258] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:30:58.232622 25641 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:30:58.233484 25641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:30:58.233851 26307 ts_tablet_manager.cc:1905] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:58.234159 26305 ts_tablet_manager.cc:1905] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:58.234617 26306 ts_tablet_manager.cc:1905] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:30:58.241600 26306 ts_tablet_manager.cc:1918] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:58.242269 26306 log.cc:1196] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/aa8ecd43436043a298589526792473b6
I20260811 01:30:58.242573 25794 tablet_service.cc:1467] Processing CreateTablet for tablet f1a20b46d9f74fbcb450982a95a2198c (DEFAULT_TABLE table=test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:58.242758 26305 ts_tablet_manager.cc:1918] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:58.242889 26306 ts_tablet_manager.cc:1939] T aa8ecd43436043a298589526792473b6 P 815a98819f8b4830ab5675f1e98b1cd3: Deleting consensus metadata
I20260811 01:30:58.242957 26305 log.cc:1196] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/aa8ecd43436043a298589526792473b6
I20260811 01:30:58.242916 25946 tablet_service.cc:1467] Processing CreateTablet for tablet f1a20b46d9f74fbcb450982a95a2198c (DEFAULT_TABLE table=test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:58.243131 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a20b46d9f74fbcb450982a95a2198c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:58.243430 25946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a20b46d9f74fbcb450982a95a2198c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:58.243448 26305 ts_tablet_manager.cc:1939] T aa8ecd43436043a298589526792473b6 P 452a16294ec24e18806b693aa727f0b1: Deleting consensus metadata
I20260811 01:30:58.247236 26307 ts_tablet_manager.cc:1918] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:30:58.247421 26307 log.cc:1196] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/aa8ecd43436043a298589526792473b6
I20260811 01:30:58.247876 26307 ts_tablet_manager.cc:1939] T aa8ecd43436043a298589526792473b6 P ea924b9ce0384030ae70df1ccea3de42: Deleting consensus metadata
I20260811 01:30:58.248944 26319 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Bootstrap starting.
I20260811 01:30:58.249058 25626 catalog_manager.cc:4841] TS ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235): tablet aa8ecd43436043a298589526792473b6 (table test-table [id=6319cf1a18b248399469bbeb28e00e80]) successfully deleted
I20260811 01:30:58.249395 26103 tablet_service.cc:1467] Processing CreateTablet for tablet f1a20b46d9f74fbcb450982a95a2198c (DEFAULT_TABLE table=test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:30:58.249836 26103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1a20b46d9f74fbcb450982a95a2198c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:30:58.250559 26317 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Bootstrap starting.
I20260811 01:30:58.250989 26319 tablet_bootstrap.cc:654] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:58.251899 26317 tablet_bootstrap.cc:654] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:58.252876 25628 catalog_manager.cc:4841] TS 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009): tablet aa8ecd43436043a298589526792473b6 (table test-table [id=6319cf1a18b248399469bbeb28e00e80]) successfully deleted
I20260811 01:30:58.253734 25627 catalog_manager.cc:4841] TS 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793): tablet aa8ecd43436043a298589526792473b6 (table test-table [id=6319cf1a18b248399469bbeb28e00e80]) successfully deleted
I20260811 01:30:58.255548 26317 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: No bootstrap required, opened a new log
I20260811 01:30:58.255774 26317 ts_tablet_manager.cc:1397] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 01:30:58.256181 26319 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: No bootstrap required, opened a new log
I20260811 01:30:58.256407 26319 ts_tablet_manager.cc:1397] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260811 01:30:58.256654 26317 raft_consensus.cc:348] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.257082 26317 raft_consensus.cc:374] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:58.257229 26317 raft_consensus.cc:729] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452a16294ec24e18806b693aa727f0b1, State: Initialized, Role: FOLLOWER
I20260811 01:30:58.257472 26318 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Bootstrap starting.
I20260811 01:30:58.257442 26319 raft_consensus.cc:348] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.257586 26317 consensus_queue.cc:260] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.257727 26319 raft_consensus.cc:374] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:58.257825 26319 raft_consensus.cc:729] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815a98819f8b4830ab5675f1e98b1cd3, State: Initialized, Role: FOLLOWER
I20260811 01:30:58.258181 26319 consensus_queue.cc:260] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.258808 26319 ts_tablet_manager.cc:1428] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:30:58.259462 26317 ts_tablet_manager.cc:1428] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 01:30:58.259645 26318 tablet_bootstrap.cc:654] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Neither blocks nor log segments found. Creating new log.
I20260811 01:30:58.263334 26318 tablet_bootstrap.cc:492] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: No bootstrap required, opened a new log
I20260811 01:30:58.263563 26318 ts_tablet_manager.cc:1397] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 01:30:58.264159 26318 raft_consensus.cc:348] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.264415 26318 raft_consensus.cc:374] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:30:58.264530 26318 raft_consensus.cc:729] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Initialized, Role: FOLLOWER
I20260811 01:30:58.264793 26318 consensus_queue.cc:260] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.265339 26318 ts_tablet_manager.cc:1428] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 01:30:58.391686 26332 raft_consensus.cc:482] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:30:58.391957 26332 raft_consensus.cc:504] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.392874 26332 leader_election.cc:288] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:58.393499 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a20b46d9f74fbcb450982a95a2198c" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1" is_pre_election: true
I20260811 01:30:58.393586 25972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a20b46d9f74fbcb450982a95a2198c" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3" is_pre_election: true
I20260811 01:30:58.393839 25819 raft_consensus.cc:2454] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:58.393868 25972 raft_consensus.cc:2454] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 0.
I20260811 01:30:58.394343 26051 leader_election.cc:302] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815a98819f8b4830ab5675f1e98b1cd3, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:58.394662 26332 raft_consensus.cc:2781] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:30:58.394799 26332 raft_consensus.cc:482] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:30:58.394884 26332 raft_consensus.cc:3037] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.397976 26332 raft_consensus.cc:504] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.398694 26332 leader_election.cc:288] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Requested vote from peers 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009), 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793)
I20260811 01:30:58.399190 25972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a20b46d9f74fbcb450982a95a2198c" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815a98819f8b4830ab5675f1e98b1cd3"
I20260811 01:30:58.399420 25972 raft_consensus.cc:3037] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.400970 25819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1a20b46d9f74fbcb450982a95a2198c" candidate_uuid: "ea924b9ce0384030ae70df1ccea3de42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "452a16294ec24e18806b693aa727f0b1"
I20260811 01:30:58.401234 25819 raft_consensus.cc:3037] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:30:58.401682 25972 raft_consensus.cc:2454] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:58.402259 26051 leader_election.cc:302] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815a98819f8b4830ab5675f1e98b1cd3, ea924b9ce0384030ae70df1ccea3de42; no voters:
I20260811 01:30:58.402577 26332 raft_consensus.cc:2781] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:30:58.402853 26332 raft_consensus.cc:686] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Becoming Leader. State: Replica: ea924b9ce0384030ae70df1ccea3de42, State: Running, Role: LEADER
I20260811 01:30:58.403151 26332 consensus_queue.cc:237] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } }
I20260811 01:30:58.403820 25819 raft_consensus.cc:2454] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea924b9ce0384030ae70df1ccea3de42 in term 1.
I20260811 01:30:58.406544 25643 catalog_manager.cc:5495] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "ea924b9ce0384030ae70df1ccea3de42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea924b9ce0384030ae70df1ccea3de42" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 37235 } health_report { overall_health: HEALTHY } } }
I20260811 01:30:58.467087 25819 raft_consensus.cc:1261] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Refusing update from remote peer ea924b9ce0384030ae70df1ccea3de42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:58.467078 25972 raft_consensus.cc:1261] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Refusing update from remote peer ea924b9ce0384030ae70df1ccea3de42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:30:58.467680 26332 consensus_queue.cc:1035] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "815a98819f8b4830ab5675f1e98b1cd3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:58.467976 26325 consensus_queue.cc:1035] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "452a16294ec24e18806b693aa727f0b1" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:30:58.473198 26286 mvcc.cc:205] Tried to move back new op lower bound from 7317142972275556352 to 7317142972021788672. Current Snapshot: MvccSnapshot[applied={T|T < 7317142972275556352}]
I20260811 01:30:58.479067 26283 mvcc.cc:205] Tried to move back new op lower bound from 7317142972275556352 to 7317142972021788672. Current Snapshot: MvccSnapshot[applied={T|T < 7317142972275556352}]
W20260811 01:30:58.488982 26286 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 01:31:00.082429 25639 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:00.082688 25639 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:00.087234 25639 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1014fa8d4c8e45dd9ed5ffa9b65f388d: Sending DeleteTablet for 3 replicas of tablet f1a20b46d9f74fbcb450982a95a2198c
I20260811 01:31:00.088131 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a20b46d9f74fbcb450982a95a2198c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:00 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:38700
I20260811 01:31:00.088172 25946 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a20b46d9f74fbcb450982a95a2198c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:00 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:49106
I20260811 01:31:00.088446 26103 tablet_service.cc:1514] Processing DeleteTablet for tablet f1a20b46d9f74fbcb450982a95a2198c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:00 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:50908
I20260811 01:31:00.088977 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25722
I20260811 01:31:00.099489 26366 tablet_replica.cc:330] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: stopping tablet replica
I20260811 01:31:00.100019 26366 raft_consensus.cc:2229] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:00.100648 26366 raft_consensus.cc:2258] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:00.101312 26365 tablet_replica.cc:330] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: stopping tablet replica
I20260811 01:31:00.101573 26365 raft_consensus.cc:2229] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:00.101862 26365 raft_consensus.cc:2258] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:00.103438 26366 ts_tablet_manager.cc:1905] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:00.107111 26365 ts_tablet_manager.cc:1905] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:00.112540 26366 ts_tablet_manager.cc:1918] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:31:00.112867 26366 log.cc:1196] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/f1a20b46d9f74fbcb450982a95a2198c
I20260811 01:31:00.113516 26366 ts_tablet_manager.cc:1939] T f1a20b46d9f74fbcb450982a95a2198c P ea924b9ce0384030ae70df1ccea3de42: Deleting consensus metadata
I20260811 01:31:00.115000 25626 catalog_manager.cc:4841] TS ea924b9ce0384030ae70df1ccea3de42 (127.23.39.195:37235): tablet f1a20b46d9f74fbcb450982a95a2198c (table test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]) successfully deleted
I20260811 01:31:00.116058 26364 tablet_replica.cc:330] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: stopping tablet replica
I20260811 01:31:00.116310 26364 raft_consensus.cc:2229] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:00.116667 26364 raft_consensus.cc:2258] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:00.116753 26365 ts_tablet_manager.cc:1918] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:31:00.116922 26365 log.cc:1196] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/f1a20b46d9f74fbcb450982a95a2198c
I20260811 01:31:00.117451 26365 ts_tablet_manager.cc:1939] T f1a20b46d9f74fbcb450982a95a2198c P 452a16294ec24e18806b693aa727f0b1: Deleting consensus metadata
I20260811 01:31:00.117766 26364 ts_tablet_manager.cc:1905] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:00.118737 25628 catalog_manager.cc:4841] TS 452a16294ec24e18806b693aa727f0b1 (127.23.39.193:43009): tablet f1a20b46d9f74fbcb450982a95a2198c (table test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]) successfully deleted
I20260811 01:31:00.123627 26364 ts_tablet_manager.cc:1918] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 01:31:00.123814 26364 log.cc:1196] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/f1a20b46d9f74fbcb450982a95a2198c
I20260811 01:31:00.124420 26364 ts_tablet_manager.cc:1939] T f1a20b46d9f74fbcb450982a95a2198c P 815a98819f8b4830ab5675f1e98b1cd3: Deleting consensus metadata
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:00.125782 25627 catalog_manager.cc:4841] TS 815a98819f8b4830ab5675f1e98b1cd3 (127.23.39.194:36793): tablet f1a20b46d9f74fbcb450982a95a2198c (table test-table [id=3e2ee46ba4324f74be4c11dde9fab2a5]) successfully deleted
I20260811 01:31:00.132740 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:00.091120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50822 (local address 127.23.39.193:43009)
0811 01:31:00.115482 (+ 24362us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:00.115489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:00.115516 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:31:00.115585 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:00.115592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:00.115732 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:00.115860 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:00.117787 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.118988 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.120224 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.120881 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.121007 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:00.126067 (+ 5060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:00.126085 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:00.126102 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:00.126198 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:00.129455 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.130381 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.130389 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.130392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.130536 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.130975 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.130980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.130990 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.131405 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:00.131737 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:00.132077 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 01:31:00.132381 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24192,"thread_start_us":24306,"threads_started":1}
W20260811 01:31:00.133543 25865 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50822
W20260811 01:31:00.134356 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25722: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:00.134563 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25722
I20260811 01:31:00.164731 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25875
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:00.180567 26369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:00.165487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.23.39.194:36793)
0811 01:31:00.166069 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:00.166073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:00.166090 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:31:00.166214 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:00.166225 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:00.166295 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:00.166391 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:00.167729 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.168565 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.169787 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.170318 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.170430 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:00.174650 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:00.174667 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:00.174684 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:00.174727 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:00.177530 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.178506 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.178514 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.178516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.178673 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.179028 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.179031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.179033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.179495 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:00.179730 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:00.180024 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 01:31:00.180201 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":333,"threads_started":1}
W20260811 01:31:00.181260 26021 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39682
W20260811 01:31:00.181974 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25875: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:00.182224 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25875
I20260811 01:31:00.210588 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26031
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:00.230643 26370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:00.211350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36376 (local address 127.23.39.195:37235)
0811 01:31:00.211953 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:00.211957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:00.211974 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:31:00.212047 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:00.212051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:00.212111 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:00.212202 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:00.213584 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.214455 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.215720 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:00.216162 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:00.216256 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:00.224401 (+ 8145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:00.224421 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:00.224438 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:00.224489 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:00.227752 (+ 3263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.228592 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.228600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.228603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.228791 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:00.229137 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:00.229140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:00.229142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:00.229622 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:00.229886 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:00.230114 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:31:00.230373 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":329,"threads_started":1}
W20260811 01:31:00.231403 26174 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36376
W20260811 01:31:00.232086 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26031: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:00.232270 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26031
I20260811 01:31:00.261065 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 25610
I20260811 01:31:00.262501 25685 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:00.384775 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 25610
2026-08-11T01:31:00Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9579 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[26374](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[26374](info): set up 2 sockets
Aug 11 01:31:00 dist-test-slave-9jjr krb5kdc[26374](info): commencing operation
krb5kdc: starting...
W20260811 01:31:01.547854 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:01 dist-test-slave-9jjr krb5kdc[26374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:01.799594 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44541
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:02.150185 26390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:02.150524 26390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:02.150691 26390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:02.158196 26390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:02.158332 26390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:02.158414 26390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:02.158504 26390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:02.158588 26390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:02.169073 26390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:44541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:02.170543 26390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:02.171969 26390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:02.184514 26395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:02.184602 26398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:02.184568 26396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:02.185510 26390 server_base.cc:1034] running on GCE node
I20260811 01:31:02.186496 26390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:02.188076 26390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:02.189337 26390 hybrid_clock.cc:648] HybridClock initialized: now 1786411862189286 us; error 62 us; skew 500 ppm
I20260811 01:31:02.189731 26390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:02 dist-test-slave-9jjr krb5kdc[26374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411862, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:02.193215 26390 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:02.194864 26390 webserver.cc:460] Webserver started at http://127.23.39.254:37085/ using document root <none> and password file <none>
I20260811 01:31:02.195564 26390 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:02.195676 26390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:02.195956 26390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:02.199299 26390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "8b829c462d194c2993a924b97c9d329c"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f96a6f4165fa598c57883d0bfadcb3b2"
server_key_iv: "6b92221932f50d2203b31faf43ac8cd4"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.200057 26390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "8b829c462d194c2993a924b97c9d329c"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f96a6f4165fa598c57883d0bfadcb3b2"
server_key_iv: "6b92221932f50d2203b31faf43ac8cd4"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.205760 26390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:31:02.209501 26405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:02.211021 26390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:02.211232 26390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "8b829c462d194c2993a924b97c9d329c"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f96a6f4165fa598c57883d0bfadcb3b2"
server_key_iv: "6b92221932f50d2203b31faf43ac8cd4"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.211462 26390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:02.228256 26390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:02.233361 26390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:02.233729 26390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:02.254657 26390 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:44541
I20260811 01:31:02.254662 26458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:44541 every 8 connection(s)
I20260811 01:31:02.256281 26390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:02.260426 26459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:02.264729 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26390
I20260811 01:31:02.264966 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:02.265646 23711 external_mini_cluster.cc:1428] Setting key d340456b4fd073a67da21721d0f69998
I20260811 01:31:02.272450 26459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c: Bootstrap starting.
I20260811 01:31:02.275905 26459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:02.277070 26459 log.cc:824] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:02.280473 26459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c: No bootstrap required, opened a new log
Aug 11 01:31:02 dist-test-slave-9jjr krb5kdc[26374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:02.289208 26459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } }
I20260811 01:31:02.289726 26459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:02.289973 26459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b829c462d194c2993a924b97c9d329c, State: Initialized, Role: FOLLOWER
I20260811 01:31:02.290659 26459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } }
I20260811 01:31:02.290959 26459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:02.291004 26462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:02.267846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34290 (local address 127.23.39.254:44541)
0811 01:31:02.268691 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:02.268703 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:02.268742 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:31:02.271087 (+ 2345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:02.271114 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:02.271566 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:02.271986 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:02.273611 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.275076 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.276542 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.277427 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.277645 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:02.281939 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:02.281948 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:02.281964 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:02.282013 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:02.285655 (+ 3642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:02.286635 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:02.286643 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:02.286650 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:02.286871 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:02.287332 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:02.287343 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:02.287346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:02.288037 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:02.288387 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:02.288871 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 01:31:02.289360 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":373,"threads_started":1}
I20260811 01:31:02.291122 26459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:02.291369 26459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:02.294296 26459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } }
I20260811 01:31:02.294811 26459 leader_election.cc:302] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b829c462d194c2993a924b97c9d329c; no voters:
I20260811 01:31:02.295384 26459 leader_election.cc:288] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:02.295547 26464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:02.296263 26464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [term 1 LEADER]: Becoming Leader. State: Replica: 8b829c462d194c2993a924b97c9d329c, State: Running, Role: LEADER
I20260811 01:31:02.296838 26464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } }
I20260811 01:31:02.297672 26459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:02.300854 26465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b829c462d194c2993a924b97c9d329c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } } }
I20260811 01:31:02.301379 26465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:02.302006 26466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b829c462d194c2993a924b97c9d329c. Latest consensus state: current_term: 1 leader_uuid: "8b829c462d194c2993a924b97c9d329c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b829c462d194c2993a924b97c9d329c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44541 } } }
I20260811 01:31:02.302457 26466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:02.306324 26471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:02.312427 26471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:02.322384 26471 catalog_manager.cc:1347] Generated new cluster ID: 83603c77738b4fae8af5b7eed97e34a2
I20260811 01:31:02.322535 26471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:02.342150 26471 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:02.343855 26471 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:02.355399 26471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b829c462d194c2993a924b97c9d329c: Generated new TSK 0
I20260811 01:31:02.356806 26471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:02.426811 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:02.786949 26486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:02.787271 26486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:02.787438 26486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:02.795419 26486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:02.795621 26486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:02.795833 26486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:02.806773 26486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:02.808272 26486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:02.809693 26486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:02.824529 26492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:02.824482 26494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:02.824576 26491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:02.825479 26486 server_base.cc:1034] running on GCE node
I20260811 01:31:02.826185 26486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:02.827286 26486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:02.828545 26486 hybrid_clock.cc:648] HybridClock initialized: now 1786411862828459 us; error 70 us; skew 500 ppm
I20260811 01:31:02.828900 26486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:02 dist-test-slave-9jjr krb5kdc[26374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411862, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:02.832314 26486 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:02.834065 26486 webserver.cc:460] Webserver started at http://127.23.39.193:42427/ using document root <none> and password file <none>
I20260811 01:31:02.834874 26486 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:02.835029 26486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:02.835362 26486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:02.838647 26486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "d811dcc28013479c9c62f2fcf6b89415"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f95088a196464f51b5de7c3c6aa1a0bc"
server_key_iv: "c0ec48e97e07978b2a8e9b6c1ce704e2"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.839505 26486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "d811dcc28013479c9c62f2fcf6b89415"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f95088a196464f51b5de7c3c6aa1a0bc"
server_key_iv: "c0ec48e97e07978b2a8e9b6c1ce704e2"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.845890 26486 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:31:02.849740 26502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:02.851372 26486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:02.851585 26486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "d811dcc28013479c9c62f2fcf6b89415"
format_stamp: "Formatted at 2026-08-11 01:31:02 on dist-test-slave-9jjr"
server_key: "f95088a196464f51b5de7c3c6aa1a0bc"
server_key_iv: "c0ec48e97e07978b2a8e9b6c1ce704e2"
server_key_version: "encryptionkey@0"
I20260811 01:31:02.851825 26486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:02.886113 26486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:02.890583 26486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:02.890914 26486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:02.891978 26486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:02.893430 26486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:02.893544 26486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:02.893715 26486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:02.893792 26486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:02.930657 26486 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:39355
I20260811 01:31:02.930718 26629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:39355 every 8 connection(s)
I20260811 01:31:02.932040 26486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:02.933697 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26486
I20260811 01:31:02.933956 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:02.934712 23711 external_mini_cluster.cc:1428] Setting key d37aa28bbc6c657b9ff45616408b8a96
Aug 11 01:31:02 dist-test-slave-9jjr krb5kdc[26374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411862, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:02.955042 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:02.934976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:58981 (local address 127.23.39.254:44541)
0811 01:31:02.935788 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:02.935794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:02.936667 (+ 873us) server_negotiation.cc:407] Connection header received
0811 01:31:02.938720 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:02.938729 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:02.938833 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:02.938961 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:02.940555 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.941777 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.943883 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.944636 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.944794 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:02.948886 (+ 4092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:02.948891 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:02.948895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:02.948931 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:02.951699 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:02.952495 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:02.952508 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:02.952511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:02.952641 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:02.953126 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:02.953130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:02.953132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:02.953407 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:02.953569 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:02.954418 (+ 849us) server_negotiation.cc:299] Negotiation successful
0811 01:31:02.954668 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":520,"threads_started":1}
I20260811 01:31:02.956328 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:02.935716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44541 (local address 127.23.39.193:58981)
0811 01:31:02.936497 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:02.936543 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:02.938433 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:02.939193 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:02.939202 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:02.939781 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:02.940365 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:02.940382 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.942017 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.942021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:02.943711 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:02.943724 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:02.944893 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:02.944898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:02.945172 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:02.946023 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:02.946069 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:02.948629 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:02.951859 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:02.951869 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:02.951888 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:02.952354 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:02.952760 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:02.952765 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:02.952769 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:02.952983 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:02.953545 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:02.953554 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:02.953962 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 01:31:02.954301 (+ 339us) client_negotiation.cc:240] Negotiation successful
0811 01:31:02.954907 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":350,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
I20260811 01:31:02.958209 26630 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44541
I20260811 01:31:02.958545 26630 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:02.959398 26630 heartbeater.cc:511] Master 127.23.39.254:44541 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
I20260811 01:31:02.962208 26423 ts_manager.cc:194] Registered new tserver with Master: d811dcc28013479c9c62f2fcf6b89415 (127.23.39.193:39355)
I20260811 01:31:02.964545 26423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:58981
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:02.989992 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:03.334471 26637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:03.334762 26637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:03.334859 26637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:03.342330 26637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:03.342446 26637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:03.342563 26637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:03.352823 26637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:03.354230 26637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:03.355777 26637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:03.371086 26643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:03.371174 26645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:03.371129 26642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:03.372265 26637 server_base.cc:1034] running on GCE node
I20260811 01:31:03.372983 26637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:03.373996 26637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:03.375228 26637 hybrid_clock.cc:648] HybridClock initialized: now 1786411863375168 us; error 79 us; skew 500 ppm
I20260811 01:31:03.375568 26637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:03 dist-test-slave-9jjr krb5kdc[26374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411863, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:03.378791 26637 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:03.380470 26637 webserver.cc:460] Webserver started at http://127.23.39.194:37139/ using document root <none> and password file <none>
I20260811 01:31:03.381350 26637 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:03.381505 26637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:03.381840 26637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:03.385053 26637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "1ae9288147e641a499f439f9ed1daef7"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "b22d66a305aa4412d235ae4655c00560"
server_key_iv: "7aa8fea76cf769cf6cd89fc3c3220c6c"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.385906 26637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "1ae9288147e641a499f439f9ed1daef7"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "b22d66a305aa4412d235ae4655c00560"
server_key_iv: "7aa8fea76cf769cf6cd89fc3c3220c6c"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.391511 26637 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:31:03.395360 26652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:03.397099 26637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:31:03.397455 26637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "1ae9288147e641a499f439f9ed1daef7"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "b22d66a305aa4412d235ae4655c00560"
server_key_iv: "7aa8fea76cf769cf6cd89fc3c3220c6c"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.397709 26637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:03.414830 26637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:03.420754 26637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:03.421198 26637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:03.422677 26637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:03.424391 26637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:03.424510 26637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:03.424721 26637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:03.424804 26637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:03.468338 26637 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:43893
I20260811 01:31:03.468386 26772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:43893 every 8 connection(s)
I20260811 01:31:03.470063 26637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:03.475436 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26637
I20260811 01:31:03.475704 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:03.476409 23711 external_mini_cluster.cc:1428] Setting key 98074c892f806e38f81f846c7fea2f4a
Aug 11 01:31:03 dist-test-slave-9jjr krb5kdc[26374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411863, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:03.498420 26777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:03.473619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:42677 (local address 127.23.39.254:44541)
0811 01:31:03.474374 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:03.474382 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:03.475976 (+ 1594us) server_negotiation.cc:407] Connection header received
0811 01:31:03.478807 (+ 2831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:03.478812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:03.478987 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:03.479165 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:03.481414 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:03.482828 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:03.484927 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:03.485786 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:03.485961 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:03.490715 (+ 4754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:03.490721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:03.490724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:03.490765 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:03.493742 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:03.494751 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:03.494763 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:03.494767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:03.494918 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:03.495451 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:03.495455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:03.495457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:03.495767 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:03.495947 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:03.497666 (+ 1719us) server_negotiation.cc:299] Negotiation successful
0811 01:31:03.497957 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":328,"threads_started":1}
I20260811 01:31:03.499403 26778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:03.474494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44541 (local address 127.23.39.194:42677)
0811 01:31:03.475722 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:03.475794 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:03.478402 (+ 2608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:03.479604 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:03.479623 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:03.480241 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:03.481088 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:03.481120 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:03.483074 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:03.483084 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:03.484678 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:03.484715 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:03.486199 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:03.486221 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:03.486523 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:03.487505 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:03.487540 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:03.490359 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:03.493965 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:03.493975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:03.494001 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:03.494602 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:03.495056 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:03.495061 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:03.495065 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:03.495306 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:03.495921 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:03.495930 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:03.496586 (+ 656us) client_negotiation.cc:769] Sending connection context
0811 01:31:03.497331 (+ 745us) client_negotiation.cc:240] Negotiation successful
0811 01:31:03.498006 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":451,"threads_started":1}
I20260811 01:31:03.501159 26773 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44541
I20260811 01:31:03.501652 26773 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
I20260811 01:31:03.502813 26773 heartbeater.cc:511] Master 127.23.39.254:44541 requested a full tablet report, sending...
I20260811 01:31:03.504997 26423 ts_manager.cc:194] Registered new tserver with Master: 1ae9288147e641a499f439f9ed1daef7 (127.23.39.194:43893)
I20260811 01:31:03.506361 26423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:42677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:03.539618 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:46267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:03.928582 26781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:03.928936 26781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:03.929106 26781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:03.937294 26781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:03.937428 26781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:03.937611 26781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:03.948773 26781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:46267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:03.950435 26781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:03.951932 26781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:31:03.968231 26630 heartbeater.cc:503] Master 127.23.39.254:44541 was elected leader, sending a full tablet report...
W20260811 01:31:03.969071 26787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:03.969205 26788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:03.970148 26781 server_base.cc:1034] running on GCE node
W20260811 01:31:03.970458 26790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:03.971338 26781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:03.972518 26781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:03.973785 26781 hybrid_clock.cc:648] HybridClock initialized: now 1786411863973724 us; error 45 us; skew 500 ppm
I20260811 01:31:03.974244 26781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:03 dist-test-slave-9jjr krb5kdc[26374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411863, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:03.977916 26781 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:03.979825 26781 webserver.cc:460] Webserver started at http://127.23.39.195:37079/ using document root <none> and password file <none>
I20260811 01:31:03.980680 26781 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:03.980856 26781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:03.981268 26781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:03.984647 26781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "14a10177811a466891a56c8637678a8f"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "03fc6107622651799cc175b563238be4"
server_key_iv: "c8a961d3c58477f8aba433fc86af0087"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.985587 26781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "14a10177811a466891a56c8637678a8f"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "03fc6107622651799cc175b563238be4"
server_key_iv: "c8a961d3c58477f8aba433fc86af0087"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.991765 26781 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:31:03.995965 26798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:03.997644 26781 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260811 01:31:03.997867 26781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "14a10177811a466891a56c8637678a8f"
format_stamp: "Formatted at 2026-08-11 01:31:03 on dist-test-slave-9jjr"
server_key: "03fc6107622651799cc175b563238be4"
server_key_iv: "c8a961d3c58477f8aba433fc86af0087"
server_key_version: "encryptionkey@0"
I20260811 01:31:03.998104 26781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:04.010766 26781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:04.015530 26781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:04.015887 26781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:04.016964 26781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:04.018585 26781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:04.018704 26781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:04.018865 26781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:04.018941 26781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:04.054960 26781 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:45351
I20260811 01:31:04.055020 26919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:45351 every 8 connection(s)
I20260811 01:31:04.056469 26781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:04.058991 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26781
I20260811 01:31:04.059186 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:04.059660 23711 external_mini_cluster.cc:1428] Setting key 29d64b2d480c7b53b6eb5f9f4909a1ce
Aug 11 01:31:04 dist-test-slave-9jjr krb5kdc[26374](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411863, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:04.078722 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:04.060597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:45181 (local address 127.23.39.254:44541)
0811 01:31:04.061061 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:04.061069 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:04.061092 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:31:04.063540 (+ 2448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:04.063544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:04.063628 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:04.063723 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:04.065435 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:04.066334 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:04.067959 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:04.068422 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:04.068532 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:04.072396 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:04.072401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:04.072404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:04.072440 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:04.075753 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:04.076555 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:04.076559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:04.076561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:04.076686 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:04.077105 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:04.077108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:04.077110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:04.077392 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:04.077509 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:04.078256 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 01:31:04.078429 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":617,"threads_started":1}
I20260811 01:31:04.079839 26922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:04.059946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44541 (local address 127.23.39.195:45181)
0811 01:31:04.060861 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:04.060923 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:04.063287 (+ 2364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:04.063954 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:04.063962 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:04.064637 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:04.065258 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:04.065276 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:04.066490 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:04.066494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:04.067809 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:04.067827 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:04.068638 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:04.068643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:04.068869 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:04.069632 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:04.069657 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:04.072162 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:04.075924 (+ 3762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:04.075932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:04.075950 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:04.076439 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:04.076812 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:04.076815 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:04.076817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:04.077010 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:04.077499 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:04.077506 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:04.077860 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 01:31:04.078108 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 01:31:04.078577 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":369,"threads_started":1}
I20260811 01:31:04.081398 26920 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44541
I20260811 01:31:04.081730 26920 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:04.082634 26920 heartbeater.cc:511] Master 127.23.39.254:44541 requested a full tablet report, sending...
I20260811 01:31:04.084299 26423 ts_manager.cc:194] Registered new tserver with Master: 14a10177811a466891a56c8637678a8f (127.23.39.195:45351)
I20260811 01:31:04.085147 26423 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:45181
I20260811 01:31:04.088524 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:31:04.130586 26923 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:04.127829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.23.39.254:44541)
0811 01:31:04.128092 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:04.128100 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:04.128477 (+ 377us) server_negotiation.cc:407] Connection header received
0811 01:31:04.128707 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:04.128711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:04.128802 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:04.128918 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:04.130281 (+ 1363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34294: BlockingRecv error: recv got EOF from 127.0.0.1:34294 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:31:04.134093 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26486
W20260811 01:31:04.137022 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26486: Not authorized: Client connection negotiation failed: client connection to 127.23.39.193:39355: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:31:04.137231 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26486
I20260811 01:31:04.157186 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26637
W20260811 01:31:04.160243 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26637: Not authorized: Client connection negotiation failed: client connection to 127.23.39.194:43893: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:31:04.160444 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26637
I20260811 01:31:04.179512 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26781
W20260811 01:31:04.182888 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26781: Not authorized: Client connection negotiation failed: client connection to 127.23.39.195:45351: server requires authentication, but client does not have Kerberos credentials available
I20260811 01:31:04.183073 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26781
I20260811 01:31:04.204471 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26390
I20260811 01:31:04.205955 26454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:04.315300 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26390
2026-08-11T01:31:04Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3923 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:04 dist-test-slave-9jjr krb5kdc[26941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:04 dist-test-slave-9jjr krb5kdc[26941](info): set up 2 sockets
Aug 11 01:31:04 dist-test-slave-9jjr krb5kdc[26941](info): commencing operation
krb5kdc: starting...
W20260811 01:31:05.499811 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:05 dist-test-slave-9jjr krb5kdc[26941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:05.754117 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39843
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:06.099329 26956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:06.099656 26956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:06.099833 26956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:06.107379 26956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:06.107512 26956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:06.107594 26956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:06.107692 26956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:06.107790 26956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:06.118248 26956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:06.119736 26956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:06.121117 26956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:06.133541 26961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:06.133622 26964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:06.133601 26962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:06.134732 26956 server_base.cc:1034] running on GCE node
I20260811 01:31:06.135605 26956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:06.137161 26956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:06.138406 26956 hybrid_clock.cc:648] HybridClock initialized: now 1786411866138346 us; error 45 us; skew 500 ppm
I20260811 01:31:06.138806 26956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:06 dist-test-slave-9jjr krb5kdc[26941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411866, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:06.142436 26956 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:06.144215 26956 webserver.cc:460] Webserver started at http://127.23.39.254:35621/ using document root <none> and password file <none>
I20260811 01:31:06.144938 26956 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:06.145045 26956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:06.145339 26956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:06.148643 26956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "36dcf9e4e5ae4cff8332509c0e90b06c"
format_stamp: "Formatted at 2026-08-11 01:31:06 on dist-test-slave-9jjr"
server_key: "01d4ced77dd62fe02a23a4e9578dcb1a"
server_key_iv: "c0c1160d4b545eca426a279f20d55c3c"
server_key_version: "encryptionkey@0"
I20260811 01:31:06.149433 26956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "36dcf9e4e5ae4cff8332509c0e90b06c"
format_stamp: "Formatted at 2026-08-11 01:31:06 on dist-test-slave-9jjr"
server_key: "01d4ced77dd62fe02a23a4e9578dcb1a"
server_key_iv: "c0c1160d4b545eca426a279f20d55c3c"
server_key_version: "encryptionkey@0"
I20260811 01:31:06.155128 26956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:31:06.159111 26971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:06.160777 26956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:06.161001 26956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "36dcf9e4e5ae4cff8332509c0e90b06c"
format_stamp: "Formatted at 2026-08-11 01:31:06 on dist-test-slave-9jjr"
server_key: "01d4ced77dd62fe02a23a4e9578dcb1a"
server_key_iv: "c0c1160d4b545eca426a279f20d55c3c"
server_key_version: "encryptionkey@0"
I20260811 01:31:06.161260 26956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:06.176905 26956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:06.181928 26956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:06.182302 26956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:06.202855 26956 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39843
I20260811 01:31:06.202914 27028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39843 every 8 connection(s)
I20260811 01:31:06.204432 26956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:06.209034 27029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:06.209187 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 26956
I20260811 01:31:06.209434 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:06.210505 23711 external_mini_cluster.cc:1428] Setting key 2bfee4fd57fc05ca00098ec37da7e130
I20260811 01:31:06.226682 27029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c: Bootstrap starting.
Aug 11 01:31:06 dist-test-slave-9jjr krb5kdc[26941](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:06.231211 27029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:06.232574 27029 log.cc:824] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:06.236066 27029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c: No bootstrap required, opened a new log
I20260811 01:31:06.239035 27032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:06.212856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.23.39.254:39843)
0811 01:31:06.213826 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:06.213840 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:06.213882 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:31:06.216617 (+ 2735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:06.216647 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:06.217176 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:06.217593 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:06.219959 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:06.221523 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:06.223824 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:06.224631 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:06.224800 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:06.230469 (+ 5669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:06.230479 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:06.230497 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:06.230547 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:06.234097 (+ 3550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:06.235074 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:06.235084 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:06.235091 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:06.235281 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:06.235741 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:06.235746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:06.235748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:06.236452 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:06.236810 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:06.237305 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 01:31:06.237789 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":498,"threads_started":1}
I20260811 01:31:06.243759 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:31:06.245841 27029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } }
I20260811 01:31:06.246431 27029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:06.246568 27029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36dcf9e4e5ae4cff8332509c0e90b06c, State: Initialized, Role: FOLLOWER
I20260811 01:31:06.247319 27029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } }
I20260811 01:31:06.247628 27029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:06.247805 27029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:06.248023 27029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:06.250840 27029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } }
I20260811 01:31:06.251555 27029 leader_election.cc:302] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36dcf9e4e5ae4cff8332509c0e90b06c; no voters:
I20260811 01:31:06.252393 27029 leader_election.cc:288] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:06.252518 27034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:06.253625 27034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [term 1 LEADER]: Becoming Leader. State: Replica: 36dcf9e4e5ae4cff8332509c0e90b06c, State: Running, Role: LEADER
I20260811 01:31:06.254346 27034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } }
I20260811 01:31:06.255359 27029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:06.258304 27036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36dcf9e4e5ae4cff8332509c0e90b06c. Latest consensus state: current_term: 1 leader_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } } }
I20260811 01:31:06.258881 27036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:06.261937 27035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36dcf9e4e5ae4cff8332509c0e90b06c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39843 } } }
I20260811 01:31:06.262385 27035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:06.269186 27040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:06.275054 27040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:06.282104 27052 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:31:06.286351 27040 catalog_manager.cc:1347] Generated new cluster ID: cee3f0465dfb486882cd132383e7ad8f
I20260811 01:31:06.286520 27040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:06.308076 27040 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:06.309743 27040 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:06.317020 27032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:06.305373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47710 (local address 127.23.39.254:39843)
0811 01:31:06.305575 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:06.305584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:06.307295 (+ 1711us) server_negotiation.cc:407] Connection header received
0811 01:31:06.307519 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:06.307524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:06.307621 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:06.307754 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:06.309281 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:06.310353 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:06.312428 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:06.313249 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:06.313398 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:06.314926 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:06.314935 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:06.314940 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:06.315914 (+ 974us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:06.316011 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:06.316054 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:06.316196 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:06.316411 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 01:31:06.316601 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:31:06.332131 27040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36dcf9e4e5ae4cff8332509c0e90b06c: Generated new TSK 0
I20260811 01:31:06.333354 27040 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:31:06.346724 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 26956
I20260811 01:31:06.348170 27024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:06.444530 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 26956
2026-08-11T01:31:06Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2128 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:06 dist-test-slave-9jjr krb5kdc[27063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:06 dist-test-slave-9jjr krb5kdc[27063](info): set up 2 sockets
Aug 11 01:31:06 dist-test-slave-9jjr krb5kdc[27063](info): commencing operation
krb5kdc: starting...
W20260811 01:31:07.630942 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:07 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:07.883275 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:41209
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:41209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:08.231359 27078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:08.231688 27078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:08.231874 27078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:08.239598 27078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:08.239727 27078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:08.239835 27078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:08.239929 27078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:08.240012 27078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:08.250624 27078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:41209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:41209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:08.252139 27078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:08.253589 27078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:08.266675 27083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:08.266738 27088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:08.266702 27085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:08.267673 27078 server_base.cc:1034] running on GCE node
I20260811 01:31:08.268632 27078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:08.270366 27078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:08.271622 27078 hybrid_clock.cc:648] HybridClock initialized: now 1786411868271565 us; error 53 us; skew 500 ppm
I20260811 01:31:08.271999 27078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:08 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411868, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:08.275722 27078 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:08.277452 27078 webserver.cc:460] Webserver started at http://127.23.39.254:41799/ using document root <none> and password file <none>
I20260811 01:31:08.278283 27078 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:08.278447 27078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:08.278806 27078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:08.282469 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "0ff6292541484d02b32cf93d1cd07f28"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "a27b2543d257fd53fb170c8b6b6e5f8b"
server_key_iv: "8745a4377ff6baad4bdd079ec9ac8665"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.283411 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "0ff6292541484d02b32cf93d1cd07f28"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "a27b2543d257fd53fb170c8b6b6e5f8b"
server_key_iv: "8745a4377ff6baad4bdd079ec9ac8665"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.289318 27078 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:31:08.293118 27097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:08.294647 27078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:08.294860 27078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "0ff6292541484d02b32cf93d1cd07f28"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "a27b2543d257fd53fb170c8b6b6e5f8b"
server_key_iv: "8745a4377ff6baad4bdd079ec9ac8665"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.295085 27078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:08.321409 27078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:08.326285 27078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:08.326624 27078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:08.346570 27078 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:41209
I20260811 01:31:08.346624 27153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:41209 every 8 connection(s)
I20260811 01:31:08.348039 27078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:08.348906 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27078
I20260811 01:31:08.349191 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:08.349901 23711 external_mini_cluster.cc:1428] Setting key 88510f69f87dd779d13d26a1414475a1
I20260811 01:31:08.352648 27154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:31:08 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:08.367067 27154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28: Bootstrap starting.
I20260811 01:31:08.370985 27154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:08.372124 27154 log.cc:824] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:08.375715 27154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28: No bootstrap required, opened a new log
I20260811 01:31:08.375860 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:08.352173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41550 (local address 127.23.39.254:41209)
0811 01:31:08.353050 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:08.353062 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:08.353106 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:31:08.354897 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:08.354920 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:08.355340 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:08.355735 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:08.357634 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:08.359134 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:08.360976 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:08.361798 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:08.361948 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:08.367190 (+ 5242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:08.367201 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:08.367247 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:08.367311 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:08.370774 (+ 3463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:08.371745 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:08.371753 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:08.371760 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:08.371973 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:08.372470 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:08.372476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:08.372486 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:08.373406 (+ 920us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:08.373754 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:08.374330 (+ 576us) server_negotiation.cc:299] Negotiation successful
0811 01:31:08.374803 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":414,"threads_started":1}
I20260811 01:31:08.384953 27154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } }
I20260811 01:31:08.385417 27154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:08.385535 27154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ff6292541484d02b32cf93d1cd07f28, State: Initialized, Role: FOLLOWER
I20260811 01:31:08.386304 27154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } }
I20260811 01:31:08.386585 27154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:08.386758 27154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:08.386953 27154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:08.389277 27154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } }
I20260811 01:31:08.389915 27154 leader_election.cc:302] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ff6292541484d02b32cf93d1cd07f28; no voters:
I20260811 01:31:08.390630 27154 leader_election.cc:288] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:08.390810 27159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:08.392047 27159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [term 1 LEADER]: Becoming Leader. State: Replica: 0ff6292541484d02b32cf93d1cd07f28, State: Running, Role: LEADER
I20260811 01:31:08.392776 27159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } }
I20260811 01:31:08.393009 27154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:08.395851 27162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ff6292541484d02b32cf93d1cd07f28. Latest consensus state: current_term: 1 leader_uuid: "0ff6292541484d02b32cf93d1cd07f28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } } }
I20260811 01:31:08.396250 27162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:08.396952 27160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ff6292541484d02b32cf93d1cd07f28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ff6292541484d02b32cf93d1cd07f28" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41209 } } }
I20260811 01:31:08.397406 27160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:08.407153 27171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:08.413313 27171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:08.423451 27171 catalog_manager.cc:1347] Generated new cluster ID: f1633db9fcfe4b6890bf7521cf800c95
I20260811 01:31:08.423609 27171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:08.474494 27171 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:08.476022 27171 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:08.490362 27171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ff6292541484d02b32cf93d1cd07f28: Generated new TSK 0
I20260811 01:31:08.491313 27171 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:08.553951 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:08.920609 27183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:08.920921 27183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:08.921252 27183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:08.929080 27183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:08.929225 27183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:08.929418 27183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:08.940025 27183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:08.941483 27183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:08.942896 27183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:08.956703 27188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:08.956614 27189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:08.956660 27192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:08.957798 27183 server_base.cc:1034] running on GCE node
I20260811 01:31:08.958518 27183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:08.959573 27183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:08.960813 27183 hybrid_clock.cc:648] HybridClock initialized: now 1786411868960756 us; error 54 us; skew 500 ppm
I20260811 01:31:08.961149 27183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:08 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411868, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:08.964509 27183 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:08.966027 27183 webserver.cc:460] Webserver started at http://127.23.39.193:45881/ using document root <none> and password file <none>
I20260811 01:31:08.966768 27183 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:08.966920 27183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:08.967250 27183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:08.970393 27183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "1115538c8dcc4edc84265a7d5a6e3ce3"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "4354ee7de129b31f2c71b263a4f902f3"
server_key_iv: "4696d0831b22b95d05cec1ba9d88b887"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.971199 27183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "1115538c8dcc4edc84265a7d5a6e3ce3"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "4354ee7de129b31f2c71b263a4f902f3"
server_key_iv: "4696d0831b22b95d05cec1ba9d88b887"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.976425 27183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:08.979933 27200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:08.981280 27183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:31:08.981474 27183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "1115538c8dcc4edc84265a7d5a6e3ce3"
format_stamp: "Formatted at 2026-08-11 01:31:08 on dist-test-slave-9jjr"
server_key: "4354ee7de129b31f2c71b263a4f902f3"
server_key_iv: "4696d0831b22b95d05cec1ba9d88b887"
server_key_version: "encryptionkey@0"
I20260811 01:31:08.981678 27183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:08.998410 27183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:09.002763 27183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:09.003093 27183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:09.004091 27183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:09.005501 27183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:09.005576 27183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:09.005741 27183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:09.005803 27183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:09.039995 27183 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:41791
I20260811 01:31:09.040046 27327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:41791 every 8 connection(s)
I20260811 01:31:09.041424 27183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:09.049927 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27183
I20260811 01:31:09.050169 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:09.050868 23711 external_mini_cluster.cc:1428] Setting key 697ec457cb039935065b98498ed328d9
Aug 11 01:31:09 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411868, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:09.063439 27330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:09.044109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:42507 (local address 127.23.39.254:41209)
0811 01:31:09.044596 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:09.044600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:09.045406 (+ 806us) server_negotiation.cc:407] Connection header received
0811 01:31:09.047321 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:09.047327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:09.047436 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:09.047560 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:09.049056 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.050095 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.051945 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.052369 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.052479 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:09.056279 (+ 3800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:09.056289 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:09.056297 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:09.056345 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:09.060108 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:09.060889 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:09.060897 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:09.060903 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:09.061068 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:09.061500 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:09.061506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:09.061510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:09.061818 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:09.061968 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:09.062948 (+ 980us) server_negotiation.cc:299] Negotiation successful
0811 01:31:09.063157 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":272,"threads_started":1}
I20260811 01:31:09.065063 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:09.044564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:41209 (local address 127.23.39.193:42507)
0811 01:31:09.045245 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:09.045292 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:09.047049 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:09.047806 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:09.047815 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:09.048333 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:09.048879 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:09.048896 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.050311 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.050317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:09.051800 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:09.051814 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.052634 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.052641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:09.052988 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:09.053710 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:09.053750 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:09.056032 (+ 2282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:09.060274 (+ 4242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:09.060281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:09.060296 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:09.060760 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:09.061182 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:09.061186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:09.061188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:09.061387 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:09.061954 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:09.061966 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:09.062508 (+ 542us) client_negotiation.cc:769] Sending connection context
0811 01:31:09.062877 (+ 369us) client_negotiation.cc:240] Negotiation successful
0811 01:31:09.063523 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":265,"threads_started":1}
I20260811 01:31:09.066745 27328 heartbeater.cc:347] Connected to a master server at 127.23.39.254:41209
I20260811 01:31:09.067065 27328 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:09.067829 27328 heartbeater.cc:511] Master 127.23.39.254:41209 requested a full tablet report, sending...
I20260811 01:31:09.069947 27116 ts_manager.cc:194] Registered new tserver with Master: 1115538c8dcc4edc84265a7d5a6e3ce3 (127.23.39.193:41791)
I20260811 01:31:09.071568 27116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:42507
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:09.105674 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:09.471609 27334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:09.471999 27334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:09.472189 27334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:09.479921 27334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:09.480139 27334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:09.480335 27334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:09.491250 27334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:09.492744 27334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:09.494218 27334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:09.509604 27339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:09.509522 27340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:09.509506 27342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:09.510819 27334 server_base.cc:1034] running on GCE node
I20260811 01:31:09.511497 27334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:09.512470 27334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:09.513736 27334 hybrid_clock.cc:648] HybridClock initialized: now 1786411869513684 us; error 57 us; skew 500 ppm
I20260811 01:31:09.514168 27334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:09 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411869, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:09.517566 27334 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:09.519239 27334 webserver.cc:460] Webserver started at http://127.23.39.194:34627/ using document root <none> and password file <none>
I20260811 01:31:09.519994 27334 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:09.520164 27334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:09.520493 27334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:09.523805 27334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "e8be337082af4842933490c5979e7fee"
format_stamp: "Formatted at 2026-08-11 01:31:09 on dist-test-slave-9jjr"
server_key: "060e171f1a72b6638f689123996618aa"
server_key_iv: "24b332756d64ec871f2ce6d14a1f20c2"
server_key_version: "encryptionkey@0"
I20260811 01:31:09.524722 27334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "e8be337082af4842933490c5979e7fee"
format_stamp: "Formatted at 2026-08-11 01:31:09 on dist-test-slave-9jjr"
server_key: "060e171f1a72b6638f689123996618aa"
server_key_iv: "24b332756d64ec871f2ce6d14a1f20c2"
server_key_version: "encryptionkey@0"
I20260811 01:31:09.530616 27334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:31:09.534468 27350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:09.535961 27334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:09.536273 27334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "e8be337082af4842933490c5979e7fee"
format_stamp: "Formatted at 2026-08-11 01:31:09 on dist-test-slave-9jjr"
server_key: "060e171f1a72b6638f689123996618aa"
server_key_iv: "24b332756d64ec871f2ce6d14a1f20c2"
server_key_version: "encryptionkey@0"
I20260811 01:31:09.536509 27334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:09.584401 27334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:09.589553 27334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:09.589900 27334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:09.591063 27334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:09.592491 27334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:09.592600 27334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:09.592768 27334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:09.592849 27334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:09.628149 27334 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:43905
I20260811 01:31:09.628189 27478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:43905 every 8 connection(s)
I20260811 01:31:09.629617 27334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:09.631996 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27334
I20260811 01:31:09.632172 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:09.632658 23711 external_mini_cluster.cc:1428] Setting key 2c243d3530589c49a542bb09b34c3280
Aug 11 01:31:09 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411869, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:09.654289 27481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:09.632465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:42727 (local address 127.23.39.254:41209)
0811 01:31:09.633000 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:09.633007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:09.634233 (+ 1226us) server_negotiation.cc:407] Connection header received
0811 01:31:09.636911 (+ 2678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:09.636915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:09.636984 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:09.637081 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:09.639435 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.640362 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.643042 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.643550 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.643685 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:09.647661 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:09.647666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:09.647669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:09.647706 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:09.650811 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:09.651681 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:09.651686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:09.651688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:09.651856 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:09.652353 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:09.652357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:09.652360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:09.652656 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:09.652834 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:09.653594 (+ 760us) server_negotiation.cc:299] Negotiation successful
0811 01:31:09.653859 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":264,"threads_started":1}
I20260811 01:31:09.655342 27482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:09.633122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:41209 (local address 127.23.39.194:42727)
0811 01:31:09.634032 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:09.634071 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:09.636566 (+ 2495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:09.637407 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:09.637424 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:09.638305 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:09.639201 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:09.639231 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.640549 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.640557 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:09.642854 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:09.642873 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:09.643835 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:09.643845 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:09.644209 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:09.644996 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:09.645020 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:09.647368 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:09.650987 (+ 3619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:09.650998 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:09.651026 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:09.651521 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:09.651984 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:09.651989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:09.651993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:09.652210 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:09.652796 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:09.652804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:09.653199 (+ 395us) client_negotiation.cc:769] Sending connection context
0811 01:31:09.653485 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 01:31:09.654095 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":381,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
I20260811 01:31:09.656968 27479 heartbeater.cc:347] Connected to a master server at 127.23.39.254:41209
I20260811 01:31:09.657292 27479 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:09.658193 27479 heartbeater.cc:511] Master 127.23.39.254:41209 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
I20260811 01:31:09.659830 27116 ts_manager.cc:194] Registered new tserver with Master: e8be337082af4842933490c5979e7fee (127.23.39.194:43905)
I20260811 01:31:09.660755 27116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:42727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:09.691829 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:31:10.074596 27328 heartbeater.cc:503] Master 127.23.39.254:41209 was elected leader, sending a full tablet report...
W20260811 01:31:10.074460 27485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:10.074774 27485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:10.074965 27485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:10.082820 27485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:10.082928 27485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:10.083041 27485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:10.093281 27485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:41209
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:10.094786 27485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:10.096079 27485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:10.109140 27490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:10.109301 27493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:10.109315 27491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:10.110021 27485 server_base.cc:1034] running on GCE node
I20260811 01:31:10.110673 27485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:10.111596 27485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:10.112843 27485 hybrid_clock.cc:648] HybridClock initialized: now 1786411870112800 us; error 52 us; skew 500 ppm
I20260811 01:31:10.113175 27485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:10.116498 27485 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:10.118036 27485 webserver.cc:460] Webserver started at http://127.23.39.195:33353/ using document root <none> and password file <none>
I20260811 01:31:10.118774 27485 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:10.118922 27485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:10.119251 27485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:10.122349 27485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "70ba81d3fc1b4681884c731fa6fe5b5c"
format_stamp: "Formatted at 2026-08-11 01:31:10 on dist-test-slave-9jjr"
server_key: "5c9bf53d51b4f77a3d5a295c768bf644"
server_key_iv: "72b0dd7300a27f6d2ef5f6503b0bd32b"
server_key_version: "encryptionkey@0"
I20260811 01:31:10.123193 27485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "70ba81d3fc1b4681884c731fa6fe5b5c"
format_stamp: "Formatted at 2026-08-11 01:31:10 on dist-test-slave-9jjr"
server_key: "5c9bf53d51b4f77a3d5a295c768bf644"
server_key_iv: "72b0dd7300a27f6d2ef5f6503b0bd32b"
server_key_version: "encryptionkey@0"
I20260811 01:31:10.128477 27485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:10.132073 27500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:10.133437 27485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:10.133628 27485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "70ba81d3fc1b4681884c731fa6fe5b5c"
format_stamp: "Formatted at 2026-08-11 01:31:10 on dist-test-slave-9jjr"
server_key: "5c9bf53d51b4f77a3d5a295c768bf644"
server_key_iv: "72b0dd7300a27f6d2ef5f6503b0bd32b"
server_key_version: "encryptionkey@0"
I20260811 01:31:10.133839 27485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:10.155484 27485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:10.160156 27485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:10.160482 27485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:10.161479 27485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:10.162875 27485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:10.162981 27485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:10.163151 27485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:10.163233 27485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:10.198081 27485 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:44455
I20260811 01:31:10.198161 27625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:44455 every 8 connection(s)
I20260811 01:31:10.199468 27485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:10.206795 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27485
I20260811 01:31:10.206970 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:10.207499 23711 external_mini_cluster.cc:1428] Setting key 76b1df177b9edd50177003765ca1dc6e
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:10.220400 27628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.202076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:39261 (local address 127.23.39.254:41209)
0811 01:31:10.202528 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:10.202533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:10.203568 (+ 1035us) server_negotiation.cc:407] Connection header received
0811 01:31:10.205431 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:10.205438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:10.205531 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:10.205654 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:10.207403 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.208240 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.210161 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.210676 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.210782 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.214349 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:10.214354 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:10.214358 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:10.214393 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:10.217489 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.218269 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.218273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.218276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.218414 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.218810 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.218813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.218815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.219105 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:10.219226 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:10.219902 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 01:31:10.220093 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":203,"threads_started":1}
I20260811 01:31:10.221504 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.202684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:41209 (local address 127.23.39.195:39261)
0811 01:31:10.203403 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:10.203451 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:10.205150 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:10.205909 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:10.205918 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:10.206537 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:10.207217 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:10.207237 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.208406 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.208411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:10.209987 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:10.210001 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.210905 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.210911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:10.211116 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.211784 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:10.211813 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:10.214065 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:10.217631 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:10.217639 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:10.217654 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:10.218104 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:10.218510 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:10.218513 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:10.218515 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:10.218706 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:10.219217 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:10.219223 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:10.219559 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 01:31:10.219802 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 01:31:10.220223 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":285,"threads_started":1}
I20260811 01:31:10.222975 27626 heartbeater.cc:347] Connected to a master server at 127.23.39.254:41209
I20260811 01:31:10.223321 27626 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:10.224086 27626 heartbeater.cc:511] Master 127.23.39.254:41209 requested a full tablet report, sending...
I20260811 01:31:10.225517 27116 ts_manager.cc:194] Registered new tserver with Master: 70ba81d3fc1b4681884c731fa6fe5b5c (127.23.39.195:44455)
I20260811 01:31:10.226435 27116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:39261
I20260811 01:31:10.236110 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:10.294018 27628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.278963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41558 (local address 127.23.39.254:41209)
0811 01:31:10.279207 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:10.279214 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:10.279718 (+ 504us) server_negotiation.cc:407] Connection header received
0811 01:31:10.279933 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:10.279937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:10.280002 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:10.280116 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:10.281576 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.282407 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.283683 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.284109 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.284258 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.288612 (+ 4354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:10.288617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:10.288621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:10.288662 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:10.291232 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.291961 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.291969 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.291977 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.292117 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.292539 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.292544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.292549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.292905 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:10.293175 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:10.293544 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 01:31:10.293766 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 01:31:10.294736 27116 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41558
I20260811 01:31:10.297083 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27183
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:10.313830 27638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.298109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45800 (local address 127.23.39.193:41791)
0811 01:31:10.298739 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:10.298746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:10.298791 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:31:10.298851 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:10.298857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:10.299127 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:10.299255 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:10.300621 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.301642 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.302989 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.303742 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.303905 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.308042 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:10.308057 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:10.308073 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:10.308117 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:10.311091 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.311846 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.311854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.311857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.311992 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.312350 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.312353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.312355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.312706 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:10.312940 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:10.313188 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 01:31:10.313414 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":287,"threads_started":1}
W20260811 01:31:10.315188 27322 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45800
W20260811 01:31:10.316337 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27183: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:10.316532 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27183
I20260811 01:31:10.336751 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27334
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:10.355635 27639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.337790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45598 (local address 127.23.39.194:43905)
0811 01:31:10.338397 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:10.338404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:10.338431 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:31:10.338501 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:10.338508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:10.338778 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:10.338937 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:10.340348 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.341512 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.342986 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.343576 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.343679 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.348366 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:10.348386 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:10.348407 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:10.348457 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:10.352433 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.353204 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.353215 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.353219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.353412 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.353802 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.353807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.353811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.354322 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:10.354618 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:10.354895 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 01:31:10.355185 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":375,"threads_started":1}
W20260811 01:31:10.357066 27474 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45598
W20260811 01:31:10.358246 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27334: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:10.358433 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27334
I20260811 01:31:10.378319 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27485
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411870, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:10.396775 27640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:10.379521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53204 (local address 127.23.39.195:44455)
0811 01:31:10.380219 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:10.380227 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:10.380258 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:31:10.380332 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:10.380339 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:10.380553 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:10.380688 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:10.382048 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.383285 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.385235 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:10.386084 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:10.386277 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:10.391049 (+ 4772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:10.391064 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:10.391080 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:10.391127 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:10.394011 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.394784 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.394792 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.394795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.394926 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:10.395326 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:10.395330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:10.395331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:10.395727 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:10.396018 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:10.396267 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 01:31:10.396490 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":379,"threads_started":1}
W20260811 01:31:10.398119 27621 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53204
W20260811 01:31:10.399364 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27485: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:31:10.399531 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27485
I20260811 01:31:10.423156 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27078
I20260811 01:31:10.424430 27148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:10.533172 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27078
2026-08-11T01:31:10Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4092 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27646](info): set up 2 sockets
Aug 11 01:31:10 dist-test-slave-9jjr krb5kdc[27646](info): commencing operation
krb5kdc: starting...
W20260811 01:31:11.708246 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:11 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:11.958493 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34117
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:34117
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:12.296782 27663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:12.297113 27663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:12.297292 27663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:12.304844 27663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:12.304970 27663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:12.305083 27663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:12.305193 27663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:12.305274 27663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:12.315623 27663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:34117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:12.317106 27663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:12.318559 27663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:12.330914 27668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:12.330955 27669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:12.331000 27671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:12.331936 27663 server_base.cc:1034] running on GCE node
I20260811 01:31:12.332805 27663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:12.334381 27663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:12.335650 27663 hybrid_clock.cc:648] HybridClock initialized: now 1786411872335601 us; error 53 us; skew 500 ppm
I20260811 01:31:12.336112 27663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:12 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411872, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:12.343186 27663 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:12.344934 27663 webserver.cc:460] Webserver started at http://127.23.39.254:33227/ using document root <none> and password file <none>
I20260811 01:31:12.345683 27663 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:12.345794 27663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:12.346076 27663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:12.349323 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "dd629813e8864c1eb5b5379a7285972f"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "fb55e9a708d3b15274452eeed454fb3a"
server_key_iv: "dbfd2f0608c99b9dba6ad618a6157a5d"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.350121 27663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "dd629813e8864c1eb5b5379a7285972f"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "fb55e9a708d3b15274452eeed454fb3a"
server_key_iv: "dbfd2f0608c99b9dba6ad618a6157a5d"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.356158 27663 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:31:12.360078 27678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:12.361552 27663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:12.361709 27663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "dd629813e8864c1eb5b5379a7285972f"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "fb55e9a708d3b15274452eeed454fb3a"
server_key_iv: "dbfd2f0608c99b9dba6ad618a6157a5d"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.361891 27663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:12.382083 27663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:12.386912 27663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:12.387171 27663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:12.407601 27663 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:34117
I20260811 01:31:12.407620 27736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:34117 every 8 connection(s)
I20260811 01:31:12.409090 27663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:12.412690 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27663
I20260811 01:31:12.412959 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:12.413242 27737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:12.413844 23711 external_mini_cluster.cc:1428] Setting key d17fc38d22f99b785e6f04c4fe7ed110
I20260811 01:31:12.429555 27737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f: Bootstrap starting.
Aug 11 01:31:12 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:12.433995 27737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:12.435504 27737 log.cc:824] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:12.439303 27737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f: No bootstrap required, opened a new log
I20260811 01:31:12.440553 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:12.416059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.23.39.254:34117)
0811 01:31:12.416947 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:12.416961 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:12.417009 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:31:12.418675 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:12.418697 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:12.419082 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:12.419423 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:12.421567 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:12.422966 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:12.424913 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:12.425705 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:12.425881 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:12.431098 (+ 5217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:12.431110 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:12.431150 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:12.431218 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:12.435460 (+ 4242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:12.436454 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:12.436464 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:12.436471 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:12.436663 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:12.437179 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:12.437184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:12.437187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:12.437915 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:12.438263 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:12.438678 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 01:31:12.439137 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":428,"threads_started":1}
I20260811 01:31:12.448292 27737 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } }
I20260811 01:31:12.448701 27737 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:12.448788 27737 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd629813e8864c1eb5b5379a7285972f, State: Initialized, Role: FOLLOWER
I20260811 01:31:12.449291 27737 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } }
I20260811 01:31:12.449529 27737 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:12.449747 27737 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:12.449934 27737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:12.452271 27737 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } }
I20260811 01:31:12.452809 27737 leader_election.cc:302] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd629813e8864c1eb5b5379a7285972f; no voters:
I20260811 01:31:12.453450 27737 leader_election.cc:288] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:12.453641 27743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:12.454362 27743 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [term 1 LEADER]: Becoming Leader. State: Replica: dd629813e8864c1eb5b5379a7285972f, State: Running, Role: LEADER
I20260811 01:31:12.454947 27743 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } }
I20260811 01:31:12.455888 27737 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:12.458101 27745 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd629813e8864c1eb5b5379a7285972f. Latest consensus state: current_term: 1 leader_uuid: "dd629813e8864c1eb5b5379a7285972f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } } }
I20260811 01:31:12.458647 27745 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:12.458690 27744 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd629813e8864c1eb5b5379a7285972f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd629813e8864c1eb5b5379a7285972f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34117 } } }
I20260811 01:31:12.459028 27744 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:12.460135 27751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:12.465812 27751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:12.476177 27751 catalog_manager.cc:1347] Generated new cluster ID: 92933b88453145f1a54a056a76a89b4e
I20260811 01:31:12.476414 27751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:12.487901 27751 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:12.489464 27751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:12.500794 27751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd629813e8864c1eb5b5379a7285972f: Generated new TSK 0
I20260811 01:31:12.502032 27751 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:12.563786 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:12.923462 27766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:12.923761 27766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:12.923926 27766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:12.931918 27766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:12.932053 27766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:12.932241 27766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:12.942859 27766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:12.944247 27766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:12.945677 27766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:12.960391 27774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:12.960522 27772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:12.960575 27771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:12.961995 27766 server_base.cc:1034] running on GCE node
I20260811 01:31:12.962818 27766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:12.963888 27766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:12.965133 27766 hybrid_clock.cc:648] HybridClock initialized: now 1786411872965069 us; error 62 us; skew 500 ppm
I20260811 01:31:12.965543 27766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:12 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411872, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:12.969256 27766 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:12.971218 27766 webserver.cc:460] Webserver started at http://127.23.39.193:40361/ using document root <none> and password file <none>
I20260811 01:31:12.972000 27766 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:12.972172 27766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:12.972529 27766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:12.975909 27766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "436032eb55db427b994a4a106a17f24e"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "970ded942417d36d8c39e776ca6039dc"
server_key_iv: "3c1332fb80c5c4ba207ace5ed93fd72e"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.977087 27766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "436032eb55db427b994a4a106a17f24e"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "970ded942417d36d8c39e776ca6039dc"
server_key_iv: "3c1332fb80c5c4ba207ace5ed93fd72e"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.983093 27766 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:31:12.987012 27782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:12.988508 27766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:12.988724 27766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "436032eb55db427b994a4a106a17f24e"
format_stamp: "Formatted at 2026-08-11 01:31:12 on dist-test-slave-9jjr"
server_key: "970ded942417d36d8c39e776ca6039dc"
server_key_iv: "3c1332fb80c5c4ba207ace5ed93fd72e"
server_key_version: "encryptionkey@0"
I20260811 01:31:12.988977 27766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:13.004380 27766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:13.008831 27766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:13.009090 27766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:13.010236 27766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:13.011673 27766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:13.011749 27766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:13.011837 27766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:13.011883 27766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:13.048219 27766 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:39691
I20260811 01:31:13.048277 27905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:39691 every 8 connection(s)
I20260811 01:31:13.049686 27766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:13.050858 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27766
I20260811 01:31:13.051107 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:13.051982 23711 external_mini_cluster.cc:1428] Setting key bd27c7be0e3df947a613cd5ce04a13f6
Aug 11 01:31:13 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411872, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:13.077004 27908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:13.052996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:51435 (local address 127.23.39.254:34117)
0811 01:31:13.053523 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:13.053530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:13.054775 (+ 1245us) server_negotiation.cc:407] Connection header received
0811 01:31:13.057792 (+ 3017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:13.057796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:13.057870 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:13.057959 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:13.060337 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.061254 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.063931 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.064672 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.064840 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:13.068908 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:13.068918 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:13.068926 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:13.068976 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:13.073030 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:13.074018 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:13.074028 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:13.074034 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:13.074269 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:13.074811 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:13.074820 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:13.074826 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:13.075271 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:13.075462 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:13.076275 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 01:31:13.076566 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":276,"threads_started":1}
I20260811 01:31:13.077762 27909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:13.053604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34117 (local address 127.23.39.193:51435)
0811 01:31:13.054583 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:13.054648 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:13.057443 (+ 2795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:13.058308 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:13.058322 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:13.059207 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:13.060140 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:13.060171 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.061432 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.061440 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:13.063733 (+ 2293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:13.063750 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.064948 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.064954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:13.065366 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:13.066287 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:13.066330 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:13.068621 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:13.073263 (+ 4642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:13.073273 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:13.073289 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:13.073831 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:13.074429 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:13.074433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:13.074436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:13.074667 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:13.075451 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:13.075457 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:13.075844 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 01:31:13.076112 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 01:31:13.076558 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":333,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
I20260811 01:31:13.079634 27906 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34117
I20260811 01:31:13.080022 27906 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:13.080865 27906 heartbeater.cc:511] Master 127.23.39.254:34117 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
I20260811 01:31:13.083446 27699 ts_manager.cc:194] Registered new tserver with Master: 436032eb55db427b994a4a106a17f24e (127.23.39.193:39691)
I20260811 01:31:13.085649 27699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:51435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:13.113808 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:13.461895 27912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:13.462330 27912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:13.462499 27912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:13.470292 27912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:13.470490 27912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:13.470705 27912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:13.481321 27912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:13.482761 27912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:13.484140 27912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:13.498898 27918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:13.498963 27920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:13.498867 27917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:13.499845 27912 server_base.cc:1034] running on GCE node
I20260811 01:31:13.500562 27912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:13.501569 27912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:13.502804 27912 hybrid_clock.cc:648] HybridClock initialized: now 1786411873502745 us; error 53 us; skew 500 ppm
I20260811 01:31:13.503155 27912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:13 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411873, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:13.506443 27912 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:13.508111 27912 webserver.cc:460] Webserver started at http://127.23.39.194:36941/ using document root <none> and password file <none>
I20260811 01:31:13.508836 27912 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:13.508986 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:13.509320 27912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:13.512480 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "52977ff9e7d04ccdabc852ce183ed474"
format_stamp: "Formatted at 2026-08-11 01:31:13 on dist-test-slave-9jjr"
server_key: "b3f128d9d7ed9a1fb77dbb4ba93b99c7"
server_key_iv: "2028ecf0eb61c498eb9d20cded4119e5"
server_key_version: "encryptionkey@0"
I20260811 01:31:13.513288 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "52977ff9e7d04ccdabc852ce183ed474"
format_stamp: "Formatted at 2026-08-11 01:31:13 on dist-test-slave-9jjr"
server_key: "b3f128d9d7ed9a1fb77dbb4ba93b99c7"
server_key_iv: "2028ecf0eb61c498eb9d20cded4119e5"
server_key_version: "encryptionkey@0"
I20260811 01:31:13.518699 27912 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:31:13.522298 27927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:13.523667 27912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:13.523861 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "52977ff9e7d04ccdabc852ce183ed474"
format_stamp: "Formatted at 2026-08-11 01:31:13 on dist-test-slave-9jjr"
server_key: "b3f128d9d7ed9a1fb77dbb4ba93b99c7"
server_key_iv: "2028ecf0eb61c498eb9d20cded4119e5"
server_key_version: "encryptionkey@0"
I20260811 01:31:13.524086 27912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:13.546986 27912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:13.551494 27912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:13.551819 27912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:13.552909 27912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:13.554437 27912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:13.554544 27912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:13.554698 27912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:13.554771 27912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:13.590329 27912 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:42173
I20260811 01:31:13.590420 28055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:42173 every 8 connection(s)
I20260811 01:31:13.591820 27912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:13.599690 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 27912
I20260811 01:31:13.599920 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:13.600387 23711 external_mini_cluster.cc:1428] Setting key 99db02f3fdc7b0359d5791618311b3ed
Aug 11 01:31:13 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411873, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:13.613091 28058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:13.594684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:33313 (local address 127.23.39.254:34117)
0811 01:31:13.595154 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:13.595158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:13.596112 (+ 954us) server_negotiation.cc:407] Connection header received
0811 01:31:13.598025 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:13.598030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:13.598168 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:13.598309 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:13.599942 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.600799 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.602791 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.603233 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.603373 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:13.607109 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:13.607114 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:13.607118 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:13.607152 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:13.609756 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:13.610642 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:13.610648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:13.610653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:13.610798 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:13.611249 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:13.611261 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:13.611263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:13.611547 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:13.611721 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:13.612460 (+ 739us) server_negotiation.cc:299] Negotiation successful
0811 01:31:13.612717 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":257,"threads_started":1}
I20260811 01:31:13.614107 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:13.595207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34117 (local address 127.23.39.194:33313)
0811 01:31:13.595934 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:13.595973 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:13.597733 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:13.598557 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:13.598566 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:13.599125 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:13.599725 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:13.599742 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.600960 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.600964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:13.602626 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:13.602641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:13.603471 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:13.603478 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:13.603717 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:13.604498 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:13.604522 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:13.606851 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:13.609924 (+ 3073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:13.609933 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:13.609954 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:13.610511 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:13.610916 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:13.610922 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:13.610926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:13.611119 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:13.611694 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:13.611702 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:13.612071 (+ 369us) client_negotiation.cc:769] Sending connection context
0811 01:31:13.612350 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:31:13.612914 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":276,"threads_started":1}
I20260811 01:31:13.615757 28056 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34117
I20260811 01:31:13.616073 28056 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:13.616811 28056 heartbeater.cc:511] Master 127.23.39.254:34117 requested a full tablet report, sending...
I20260811 01:31:13.618412 27699 ts_manager.cc:194] Registered new tserver with Master: 52977ff9e7d04ccdabc852ce183ed474 (127.23.39.194:42173)
I20260811 01:31:13.619813 27699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:33313
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:13.658715 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:14.011926 28062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:14.012241 28062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:14.012348 28062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:14.019912 28062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:14.020109 28062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:14.020305 28062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:14.031109 28062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:14.032555 28062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:14.034018 28062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:14.048458 28069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:14.048411 28070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:14.048743 28072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:14.049485 28062 server_base.cc:1034] running on GCE node
I20260811 01:31:14.050252 28062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:14.051496 28062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:14.052747 28062 hybrid_clock.cc:648] HybridClock initialized: now 1786411874052695 us; error 47 us; skew 500 ppm
I20260811 01:31:14.053077 28062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:14.056831 28062 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:14.058529 28062 webserver.cc:460] Webserver started at http://127.23.39.195:36023/ using document root <none> and password file <none>
I20260811 01:31:14.059254 28062 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:14.059401 28062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:14.059732 28062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:14.063032 28062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "d32d27a342ba434fad20fef5dd1231d3"
format_stamp: "Formatted at 2026-08-11 01:31:14 on dist-test-slave-9jjr"
server_key: "2c9c40cc2899d358adddea2a558dc047"
server_key_iv: "a01891068bba32d8f30760a8741d8ebd"
server_key_version: "encryptionkey@0"
I20260811 01:31:14.063934 28062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "d32d27a342ba434fad20fef5dd1231d3"
format_stamp: "Formatted at 2026-08-11 01:31:14 on dist-test-slave-9jjr"
server_key: "2c9c40cc2899d358adddea2a558dc047"
server_key_iv: "a01891068bba32d8f30760a8741d8ebd"
server_key_version: "encryptionkey@0"
I20260811 01:31:14.069722 28062 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:31:14.073464 28079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:14.075004 28062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:31:14.075186 28062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "d32d27a342ba434fad20fef5dd1231d3"
format_stamp: "Formatted at 2026-08-11 01:31:14 on dist-test-slave-9jjr"
server_key: "2c9c40cc2899d358adddea2a558dc047"
server_key_iv: "a01891068bba32d8f30760a8741d8ebd"
server_key_version: "encryptionkey@0"
I20260811 01:31:14.075445 28062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:14.088922 27906 heartbeater.cc:503] Master 127.23.39.254:34117 was elected leader, sending a full tablet report...
I20260811 01:31:14.089275 28062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:14.094094 28062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:14.094450 28062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:14.095446 28062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:14.096807 28062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:14.096910 28062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:14.097064 28062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:14.097143 28062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:14.132318 28062 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:38997
I20260811 01:31:14.132367 28210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:38997 every 8 connection(s)
I20260811 01:31:14.133673 28062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:14.135316 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28062
I20260811 01:31:14.135528 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:14.136053 23711 external_mini_cluster.cc:1428] Setting key 06b66ae602b3f97287f7c0007fa7ea6d
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:14.155592 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.136631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:56127 (local address 127.23.39.254:34117)
0811 01:31:14.137149 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.137154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.138347 (+ 1193us) server_negotiation.cc:407] Connection header received
0811 01:31:14.140461 (+ 2114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.140467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.140572 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.140705 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.142391 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.143237 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.144931 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.145359 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.145501 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.149190 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.149195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.149198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.149234 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.152230 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.153026 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.153032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.153034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.153173 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.153682 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.153686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.153688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.153970 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.154190 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.154946 (+ 756us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.155187 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":269,"threads_started":1}
I20260811 01:31:14.156700 28214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.137165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34117 (local address 127.23.39.195:56127)
0811 01:31:14.138154 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:14.138217 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:14.140165 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:14.140964 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:14.140974 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:14.141527 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:14.142207 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:14.142229 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.143422 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.143427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:14.144720 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:14.144734 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.145620 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.145628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:14.145869 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.146604 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:14.146630 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:14.148943 (+ 2313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:14.152401 (+ 3458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:14.152410 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:14.152429 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:14.152883 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:14.153295 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:14.153300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:14.153304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:14.153525 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:14.154164 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:14.154173 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:14.154556 (+ 383us) client_negotiation.cc:769] Sending connection context
0811 01:31:14.154838 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 01:31:14.155429 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":370,"threads_started":1}
I20260811 01:31:14.158202 28211 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34117
I20260811 01:31:14.158552 28211 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:14.159320 28211 heartbeater.cc:511] Master 127.23.39.254:34117 requested a full tablet report, sending...
I20260811 01:31:14.160924 27699 ts_manager.cc:194] Registered new tserver with Master: d32d27a342ba434fad20fef5dd1231d3 (127.23.39.195:38997)
I20260811 01:31:14.161792 27699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:56127
I20260811 01:31:14.164563 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:14.224237 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.208055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58968 (local address 127.23.39.193:39691)
0811 01:31:14.208802 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.208809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.208835 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:31:14.208898 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.208905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.209141 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.209317 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.210960 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.211979 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.213260 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.213853 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.213999 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.218500 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.218516 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.218531 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.218576 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.221406 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.222068 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.222074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.222077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.222301 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.222640 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.222643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.222645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.222990 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.223268 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.223546 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.223822 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":361,"threads_started":1}
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:14.243541 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.229221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.23.39.254:34117)
0811 01:31:14.229397 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.229401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.229552 (+ 151us) server_negotiation.cc:407] Connection header received
0811 01:31:14.229683 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.229687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.229752 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.229838 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.231166 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.231913 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.233103 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.233521 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.233682 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.237878 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.237883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.237887 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.237924 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.240837 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.241555 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.241560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.241563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.241758 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.242157 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.242162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.242165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.242576 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.242773 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.243118 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.243303 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 01:31:14.244218 27699 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46464
I20260811 01:31:14.245373 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27766
I20260811 01:31:14.259060 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.246361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58978 (local address 127.23.39.193:39691)
0811 01:31:14.246538 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.246542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.246816 (+ 274us) server_negotiation.cc:407] Connection header received
0811 01:31:14.246951 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.246954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.247018 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.247146 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.248441 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.249181 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.250533 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.250977 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.251097 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.253414 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.253420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.253423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.253473 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.256475 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.257191 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.257199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.257205 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.257371 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.257709 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.257712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.257714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.257986 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.258263 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.258563 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.258801 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:31:14.259793 27901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:14.348502 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27766
I20260811 01:31:14.369318 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27912
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:14.386422 28226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.370330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48586 (local address 127.23.39.194:42173)
0811 01:31:14.370936 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.370943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.370969 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:31:14.371033 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.371039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.371248 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.371392 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.372599 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.373648 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.375080 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.375676 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.375782 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.380238 (+ 4456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.380251 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.380267 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.380310 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.383409 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.384121 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.384128 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.384131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.384283 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.384703 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.384707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.384716 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.385113 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.385360 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.385707 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.386009 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":352,"threads_started":1}
I20260811 01:31:14.387691 28051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:14.481004 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27912
I20260811 01:31:14.500222 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28062
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[27646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:14.516767 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:14.501331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.23.39.195:38997)
0811 01:31:14.501942 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:14.501949 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:14.501980 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:31:14.502042 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:14.502049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:14.502340 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:14.502473 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:14.503745 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.504783 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.506056 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:14.506721 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:14.506822 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:14.511321 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:14.511334 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:14.511349 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:14.511386 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:14.514248 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.514944 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.514951 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.514953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.515075 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:14.515400 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:14.515403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:14.515405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:14.515762 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:14.515997 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:14.516258 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 01:31:14.516474 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":288,"threads_started":1}
I20260811 01:31:14.518085 28205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:14.603202 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28062
I20260811 01:31:14.623040 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 27663
I20260811 01:31:14.624336 27731 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:14.744168 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 27663
2026-08-11T01:31:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4212 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[28234](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[28234](info): set up 2 sockets
Aug 11 01:31:14 dist-test-slave-9jjr krb5kdc[28234](info): commencing operation
krb5kdc: starting...
W20260811 01:31:15.924088 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:16 dist-test-slave-9jjr krb5kdc[28234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:16.184157 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44159
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:44159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:16.538326 28247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:16.538652 28247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:16.538833 28247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:16.546547 28247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:16.546679 28247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:16.546778 28247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:16.546881 28247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:16.546968 28247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:16.557693 28247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:44159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:16.559199 28247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:16.560922 28247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:16.572942 28254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:16.572985 28253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:16.572942 28256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:16.575789 28247 server_base.cc:1034] running on GCE node
I20260811 01:31:16.576676 28247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:16.578321 28247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:16.579567 28247 hybrid_clock.cc:648] HybridClock initialized: now 1786411876579528 us; error 40 us; skew 500 ppm
I20260811 01:31:16.580009 28247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:16 dist-test-slave-9jjr krb5kdc[28234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:16.583446 28247 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:16.584771 28247 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:16.584908 28247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:16.585253 28247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:16.588444 28247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "f1376c72e2924881ba04cb3cfc78a9df"
format_stamp: "Formatted at 2026-08-11 01:31:16 on dist-test-slave-9jjr"
server_key: "0928ced895b4a31a6f0ee283f43ccdb5"
server_key_iv: "b3a26044c380d255aa7433c3a43b5aa9"
server_key_version: "encryptionkey@0"
I20260811 01:31:16.589309 28247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "f1376c72e2924881ba04cb3cfc78a9df"
format_stamp: "Formatted at 2026-08-11 01:31:16 on dist-test-slave-9jjr"
server_key: "0928ced895b4a31a6f0ee283f43ccdb5"
server_key_iv: "b3a26044c380d255aa7433c3a43b5aa9"
server_key_version: "encryptionkey@0"
I20260811 01:31:16.594633 28247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 01:31:16.598065 28263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:16.599511 28247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:16.599689 28247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "f1376c72e2924881ba04cb3cfc78a9df"
format_stamp: "Formatted at 2026-08-11 01:31:16 on dist-test-slave-9jjr"
server_key: "0928ced895b4a31a6f0ee283f43ccdb5"
server_key_iv: "b3a26044c380d255aa7433c3a43b5aa9"
server_key_version: "encryptionkey@0"
I20260811 01:31:16.599929 28247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:16.612680 28247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:16.617369 28247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:16.617610 28247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:16.637369 28247 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:44159
I20260811 01:31:16.637395 28327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:44159 every 8 connection(s)
I20260811 01:31:16.638468 28247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:16.641342 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28247
I20260811 01:31:16.641580 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:16.642318 23711 external_mini_cluster.cc:1428] Setting key 2302e4f2bf9e89304524c8a9de16e79f
I20260811 01:31:16.642690 28328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:16.658700 28328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: Bootstrap starting.
Aug 11 01:31:16 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:16.662602 28328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:16.664230 28328 log.cc:824] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:16.667562 28328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: No bootstrap required, opened a new log
I20260811 01:31:16.670428 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:16.644586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55086 (local address 127.23.39.254:44159)
0811 01:31:16.645539 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:16.645551 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:16.645597 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:31:16.647700 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:16.647726 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:16.648187 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:16.648581 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:16.650699 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:16.652113 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:16.654081 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:16.654947 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:16.655101 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:16.661539 (+ 6438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:16.661549 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:16.661565 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:16.661642 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:16.665717 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:16.666685 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:16.666693 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:16.666700 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:16.666896 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:16.667330 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:16.667336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:16.667341 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:16.667975 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:16.668318 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:16.668788 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 01:31:16.669256 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":441,"threads_started":1}
I20260811 01:31:16.675944 28328 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } }
I20260811 01:31:16.676396 28328 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:16.676512 28328 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1376c72e2924881ba04cb3cfc78a9df, State: Initialized, Role: FOLLOWER
I20260811 01:31:16.677245 28328 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } }
I20260811 01:31:16.677569 28328 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:16.677737 28328 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:16.677930 28328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:16.680361 28328 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } }
I20260811 01:31:16.680997 28328 leader_election.cc:302] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1376c72e2924881ba04cb3cfc78a9df; no voters:
I20260811 01:31:16.681711 28328 leader_election.cc:288] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:16.681854 28334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:16.682689 28334 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [term 1 LEADER]: Becoming Leader. State: Replica: f1376c72e2924881ba04cb3cfc78a9df, State: Running, Role: LEADER
I20260811 01:31:16.683295 28334 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } }
I20260811 01:31:16.684125 28328 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:16.686339 28337 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1376c72e2924881ba04cb3cfc78a9df. Latest consensus state: current_term: 1 leader_uuid: "f1376c72e2924881ba04cb3cfc78a9df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } } }
I20260811 01:31:16.686316 28335 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1376c72e2924881ba04cb3cfc78a9df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1376c72e2924881ba04cb3cfc78a9df" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44159 } } }
I20260811 01:31:16.686914 28335 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:16.686913 28337 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:16.689018 28340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:16.693725 28340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:16.703711 28340 catalog_manager.cc:1347] Generated new cluster ID: 66be90e2b2114247a71144314e6af84d
I20260811 01:31:16.703853 28340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:16.714496 28340 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:16.715896 28340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:16.737921 28340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: Generated new TSK 0
I20260811 01:31:16.738902 28340 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:16.806645 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:17.178566 28358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:17.178876 28358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:17.178977 28358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:17.186578 28358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:17.186698 28358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:17.186821 28358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:17.197676 28358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:17.199172 28358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:17.200637 28358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:17.214227 28366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:17.214437 28368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:17.214730 28364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:17.215242 28358 server_base.cc:1034] running on GCE node
I20260811 01:31:17.215920 28358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:17.216926 28358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:17.218214 28358 hybrid_clock.cc:648] HybridClock initialized: now 1786411877218153 us; error 58 us; skew 500 ppm
I20260811 01:31:17.218549 28358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:17 dist-test-slave-9jjr krb5kdc[28234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411877, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:17.221846 28358 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:17.223160 28358 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:17.223310 28358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:17.223654 28358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:17.226876 28358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "fad06ccbeb05419b8b29ad797aec3fb5"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "333ad587fc4a354661496350a485afc2"
server_key_iv: "ac23bfabc29d0f633c4ab182a6cb838c"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.227757 28358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "fad06ccbeb05419b8b29ad797aec3fb5"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "333ad587fc4a354661496350a485afc2"
server_key_iv: "ac23bfabc29d0f633c4ab182a6cb838c"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.233196 28358 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:31:17.237048 28374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.238521 28358 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:17.238708 28358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "fad06ccbeb05419b8b29ad797aec3fb5"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "333ad587fc4a354661496350a485afc2"
server_key_iv: "ac23bfabc29d0f633c4ab182a6cb838c"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.238955 28358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:17.251502 28358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:17.255920 28358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:17.256244 28358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:17.257285 28358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:17.258788 28358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:17.258913 28358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.259054 28358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:17.259146 28358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.293385 28358 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33613
I20260811 01:31:17.293474 28502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33613 every 8 connection(s)
I20260811 01:31:17.294351 28358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:17.297425 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28358
I20260811 01:31:17.297660 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:17.298606 23711 external_mini_cluster.cc:1428] Setting key 1910ffadd6601f6c4b63497a8eaf85e8
Aug 11 01:31:17 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411877, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:17.320235 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:17.296988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:51071 (local address 127.23.39.254:44159)
0811 01:31:17.297478 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:17.297482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:17.299324 (+ 1842us) server_negotiation.cc:407] Connection header received
0811 01:31:17.300739 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:17.300744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:17.300844 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:17.300933 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:17.303283 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.304154 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.306913 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.307479 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.307603 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:17.312550 (+ 4947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:17.312560 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:17.312568 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:17.312624 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:17.316491 (+ 3867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:17.317374 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:17.317383 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:17.317389 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:17.317553 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:17.318008 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:17.318016 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:17.318022 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:17.318517 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:17.318677 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:17.319443 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 01:31:17.319719 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":280,"threads_started":1}
I20260811 01:31:17.320969 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:17.297725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44159 (local address 127.23.39.193:51071)
0811 01:31:17.298575 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:17.298622 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:17.300467 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:17.301274 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:17.301286 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:17.302152 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:17.303074 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:17.303106 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.304363 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.304371 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:17.306694 (+ 2323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:17.306714 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.307756 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.307765 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:17.308113 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:17.308977 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:17.309023 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:17.312215 (+ 3192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:17.316679 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:17.316688 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:17.316704 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:17.317210 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:17.317668 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:17.317671 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:17.317674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:17.317878 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:17.318650 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:17.318657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:17.319023 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 01:31:17.319268 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 01:31:17.319702 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":401,"threads_started":1}
I20260811 01:31:17.322760 28503 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44159
I20260811 01:31:17.323163 28503 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:17.324090 28503 heartbeater.cc:511] Master 127.23.39.254:44159 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
I20260811 01:31:17.326543 28285 ts_manager.cc:194] Registered new tserver with Master: fad06ccbeb05419b8b29ad797aec3fb5 (127.23.39.193:33613)
I20260811 01:31:17.328069 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:51071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:17.361369 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:17.710822 28510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:17.711210 28510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:17.711400 28510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:17.719153 28510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:17.719350 28510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:17.719532 28510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:17.730258 28510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:17.731752 28510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:17.733132 28510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:17.746835 28516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:17.746953 28517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:17.746958 28519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:17.747996 28510 server_base.cc:1034] running on GCE node
I20260811 01:31:17.748695 28510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:17.749790 28510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:17.751060 28510 hybrid_clock.cc:648] HybridClock initialized: now 1786411877750969 us; error 80 us; skew 500 ppm
I20260811 01:31:17.751464 28510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:17 dist-test-slave-9jjr krb5kdc[28234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411877, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:17.759721 28510 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:17.761127 28510 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:17.761289 28510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:17.761651 28510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:17.765074 28510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "0136220ab92548b1a8048ffb74f2a777"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "8b6b800dad0b0c3a4ade14b583b371f7"
server_key_iv: "1586c6749ec62fa627841fcb822dc56f"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.766104 28510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "0136220ab92548b1a8048ffb74f2a777"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "8b6b800dad0b0c3a4ade14b583b371f7"
server_key_iv: "1586c6749ec62fa627841fcb822dc56f"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.772106 28510 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:31:17.776391 28526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.777812 28510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:17.778043 28510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "0136220ab92548b1a8048ffb74f2a777"
format_stamp: "Formatted at 2026-08-11 01:31:17 on dist-test-slave-9jjr"
server_key: "8b6b800dad0b0c3a4ade14b583b371f7"
server_key_iv: "1586c6749ec62fa627841fcb822dc56f"
server_key_version: "encryptionkey@0"
I20260811 01:31:17.778391 28510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:17.832389 28510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:17.837363 28510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:17.837760 28510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:17.838889 28510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:17.840385 28510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:17.840478 28510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.840653 28510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:17.840742 28510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:17.876433 28510 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:40137
I20260811 01:31:17.876515 28654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:40137 every 8 connection(s)
I20260811 01:31:17.877352 28510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:17.878626 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28510
I20260811 01:31:17.878852 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:17.879429 23711 external_mini_cluster.cc:1428] Setting key a141aa278721261060f43e9fa9995bdd
Aug 11 01:31:17 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411877, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:17.900779 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:17.880301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:48991 (local address 127.23.39.254:44159)
0811 01:31:17.880825 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:17.880831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:17.882014 (+ 1183us) server_negotiation.cc:407] Connection header received
0811 01:31:17.885237 (+ 3223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:17.885244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:17.885332 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:17.885486 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:17.887257 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.888023 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.889612 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.890075 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.890272 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:17.894295 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:17.894301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:17.894304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:17.894340 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:17.897393 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:17.898268 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:17.898273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:17.898275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:17.898406 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:17.898880 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:17.898884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:17.898886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:17.899195 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:17.899371 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:17.900147 (+ 776us) server_negotiation.cc:299] Negotiation successful
0811 01:31:17.900399 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":265,"threads_started":1}
I20260811 01:31:17.901899 28658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:17.880985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44159 (local address 127.23.39.194:48991)
0811 01:31:17.881836 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:17.881887 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:17.884815 (+ 2928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:17.885773 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:17.885782 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:17.886446 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:17.887060 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:17.887077 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.888195 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.888200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:17.889461 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:17.889473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:17.890372 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:17.890380 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:17.890629 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:17.891382 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:17.891406 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:17.894013 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:17.897561 (+ 3548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:17.897571 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:17.897599 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:17.898079 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:17.898525 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:17.898530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:17.898534 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:17.898747 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:17.899352 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:17.899360 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:17.899743 (+ 383us) client_negotiation.cc:769] Sending connection context
0811 01:31:17.900020 (+ 277us) client_negotiation.cc:240] Negotiation successful
0811 01:31:17.900617 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":331,"threads_started":1}
I20260811 01:31:17.903553 28655 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44159
I20260811 01:31:17.903905 28655 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:17.904609 28655 heartbeater.cc:511] Master 127.23.39.254:44159 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
I20260811 01:31:17.906288 28285 ts_manager.cc:194] Registered new tserver with Master: 0136220ab92548b1a8048ffb74f2a777 (127.23.39.194:40137)
I20260811 01:31:17.907238 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:48991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:17.938436 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:18.286926 28661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:18.287228 28661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:18.287335 28661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:18.296401 28661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:18.296561 28661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:18.296772 28661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:18.308439 28661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:18.309780 28661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:18.311172 28661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:18.324676 28666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:18.324630 28669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:18.324596 28667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:18.325537 28661 server_base.cc:1034] running on GCE node
I20260811 01:31:18.326211 28661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:18.327190 28661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:18.328459 28661 hybrid_clock.cc:648] HybridClock initialized: now 1786411878328385 us; error 68 us; skew 500 ppm
I20260811 01:31:18.328832 28661 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:18.331634 28503 heartbeater.cc:503] Master 127.23.39.254:44159 was elected leader, sending a full tablet report...
Aug 11 01:31:18 dist-test-slave-9jjr krb5kdc[28234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411878, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:18.332448 28661 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:18.333846 28661 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:18.333994 28661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:18.334434 28661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:18.337597 28661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "111cc0d7cdbe467f8101d671d98784de"
format_stamp: "Formatted at 2026-08-11 01:31:18 on dist-test-slave-9jjr"
server_key: "2c9dd1fd27b79a5bc8cfe9e6447d4840"
server_key_iv: "ab9fa0ad49b54f6490f0c05dd32eb435"
server_key_version: "encryptionkey@0"
I20260811 01:31:18.338536 28661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "111cc0d7cdbe467f8101d671d98784de"
format_stamp: "Formatted at 2026-08-11 01:31:18 on dist-test-slave-9jjr"
server_key: "2c9dd1fd27b79a5bc8cfe9e6447d4840"
server_key_iv: "ab9fa0ad49b54f6490f0c05dd32eb435"
server_key_version: "encryptionkey@0"
I20260811 01:31:18.344105 28661 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 01:31:18.347833 28676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:18.349237 28661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:31:18.349462 28661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "111cc0d7cdbe467f8101d671d98784de"
format_stamp: "Formatted at 2026-08-11 01:31:18 on dist-test-slave-9jjr"
server_key: "2c9dd1fd27b79a5bc8cfe9e6447d4840"
server_key_iv: "ab9fa0ad49b54f6490f0c05dd32eb435"
server_key_version: "encryptionkey@0"
I20260811 01:31:18.349718 28661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:18.376583 28661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:18.380872 28661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:18.381193 28661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:18.382303 28661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:18.383816 28661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:18.383939 28661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:18.384087 28661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:18.384198 28661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:18.420239 28661 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:34179
I20260811 01:31:18.420341 28803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:34179 every 8 connection(s)
I20260811 01:31:18.421169 28661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:18.425236 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28661
I20260811 01:31:18.425494 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:18.426074 23711 external_mini_cluster.cc:1428] Setting key 06b7fbd70d9db071e2e5c3cc6e57626a
Aug 11 01:31:18 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411878, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:18.443512 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.423756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46141 (local address 127.23.39.254:44159)
0811 01:31:18.424274 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.424282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.425522 (+ 1240us) server_negotiation.cc:407] Connection header received
0811 01:31:18.428180 (+ 2658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.428184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.428309 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.428440 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:18.430300 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.431095 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.432678 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.433090 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.433193 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.436717 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:18.436723 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:18.436726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:18.436782 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:18.439690 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.440635 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.440639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.440641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.440790 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.441388 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.441393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.441395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.441684 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:18.441876 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.442872 (+ 996us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.443123 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":234,"threads_started":1}
I20260811 01:31:18.444561 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.424386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44159 (local address 127.23.39.195:46141)
0811 01:31:18.425301 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.425362 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.427854 (+ 2492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.428741 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.428750 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.429329 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:18.430076 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.430095 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.431247 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.431256 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.432516 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.432528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.433292 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.433296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.433490 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.434260 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:18.434285 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:18.436495 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:18.439832 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:18.439839 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:18.439872 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:18.440494 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:18.440915 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:18.440920 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:18.440924 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:18.441224 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:18.441836 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:18.441844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:18.442369 (+ 525us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.442748 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.443372 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":360,"threads_started":1}
I20260811 01:31:18.445935 28804 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44159
I20260811 01:31:18.446291 28804 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:18.446995 28804 heartbeater.cc:511] Master 127.23.39.254:44159 requested a full tablet report, sending...
I20260811 01:31:18.448490 28285 ts_manager.cc:194] Registered new tserver with Master: 111cc0d7cdbe467f8101d671d98784de (127.23.39.195:34179)
I20260811 01:31:18.449329 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:46141
I20260811 01:31:18.454835 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:31:18.473125 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.459850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55092 (local address 127.23.39.254:44159)
0811 01:31:18.460115 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.460122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.460571 (+ 449us) server_negotiation.cc:407] Connection header received
0811 01:31:18.460792 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.460798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.460882 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.460994 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:18.462602 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.463372 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.464671 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.465089 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.465231 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.467716 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:18.467721 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:18.467724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:18.467760 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:18.470369 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.471065 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.471070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.471074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.471206 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.471591 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.471612 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.471614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.471940 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:18.472200 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.472544 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.472785 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:31:18.477437 28285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55092:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:18.484557 28285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:18.508622 28822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.497350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33613 (local address 127.0.0.1:38206)
0811 01:31:18.499845 (+ 2495us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.499869 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.500132 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.501052 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.501057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.501085 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:18.501489 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.501498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.503602 (+ 2104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.503607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.505824 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.505836 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.507619 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.507625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.507827 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.507885 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.508035 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.508240 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2291,"thread_start_us":2262,"threads_started":1}
I20260811 01:31:18.508613 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.497803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38206 (local address 127.23.39.193:33613)
0811 01:31:18.499037 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.499049 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.499995 (+ 946us) server_negotiation.cc:407] Connection header received
0811 01:31:18.500356 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.500367 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.500672 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.500862 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:18.501698 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.503341 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.505978 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.507444 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.507591 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.507847 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.508079 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.508241 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1019,"thread_start_us":870,"threads_started":1}
I20260811 01:31:18.509716 28818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.497114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34179 (local address 127.0.0.1:35826)
0811 01:31:18.498095 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.498179 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.498376 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.500947 (+ 2571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.500955 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.500985 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:18.501401 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.501418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.503991 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.503997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.506880 (+ 2883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.506896 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.508817 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.508827 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.509004 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.509038 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.509112 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.509275 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"mutex_wait_us":168,"thread_start_us":523,"threads_started":1}
I20260811 01:31:18.510143 28820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.498837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:40137 (local address 127.0.0.1:46472)
0811 01:31:18.499900 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.499917 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.500035 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.501618 (+ 1583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.501623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.501653 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:18.502181 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.502195 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.504037 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.504052 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.506888 (+ 2836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.506897 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.509178 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.509184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.509340 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.509382 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.509466 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.509596 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":127,"thread_start_us":395,"threads_started":1}
I20260811 01:31:18.510963 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.497356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.23.39.195:34179)
0811 01:31:18.500255 (+ 2899us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.500263 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.500296 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:31:18.500392 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.500399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.500662 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.501625 (+ 963us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:18.502010 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.503722 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.507082 (+ 3360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.508547 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.510096 (+ 1549us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.510380 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.510453 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.510633 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1269,"thread_start_us":1113,"threads_started":1}
I20260811 01:31:18.511019 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.499120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46472 (local address 127.23.39.194:40137)
0811 01:31:18.501052 (+ 1932us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.501060 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.501088 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:31:18.501188 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.501194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.501421 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.501624 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:18.502378 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.503921 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.507083 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.508547 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.509779 (+ 1232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.510464 (+ 685us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.510535 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.510685 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1774,"thread_start_us":1630,"threads_started":1}
I20260811 01:31:18.512866 28428 tablet_service.cc:1467] Processing CreateTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (DEFAULT_TABLE table=test-table [id=5387f2f794a74391855ae8f1bfac964e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:18.514500 28428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c0edc9c6b04cb39ac985fe4ad43b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:18.514119 28579 tablet_service.cc:1467] Processing CreateTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (DEFAULT_TABLE table=test-table [id=5387f2f794a74391855ae8f1bfac964e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:18.514578 28731 tablet_service.cc:1467] Processing CreateTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (DEFAULT_TABLE table=test-table [id=5387f2f794a74391855ae8f1bfac964e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:18.515321 28579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c0edc9c6b04cb39ac985fe4ad43b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:18.515895 28731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c0edc9c6b04cb39ac985fe4ad43b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:18.527068 28824 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Bootstrap starting.
I20260811 01:31:18.529474 28825 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Bootstrap starting.
I20260811 01:31:18.531147 28826 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Bootstrap starting.
I20260811 01:31:18.532229 28824 tablet_bootstrap.cc:654] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:18.533291 28824 log.cc:824] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:18.533507 28825 tablet_bootstrap.cc:654] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:18.534771 28826 tablet_bootstrap.cc:654] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:18.534849 28825 log.cc:824] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:18.536021 28826 log.cc:824] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:18.536521 28824 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: No bootstrap required, opened a new log
I20260811 01:31:18.536862 28824 ts_tablet_manager.cc:1397] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 01:31:18.538266 28825 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: No bootstrap required, opened a new log
I20260811 01:31:18.538560 28825 ts_tablet_manager.cc:1397] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:31:18.539991 28826 tablet_bootstrap.cc:492] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: No bootstrap required, opened a new log
I20260811 01:31:18.540277 28826 ts_tablet_manager.cc:1397] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260811 01:31:18.545658 28824 raft_consensus.cc:348] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.546089 28824 raft_consensus.cc:374] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:18.546214 28824 raft_consensus.cc:729] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0136220ab92548b1a8048ffb74f2a777, State: Initialized, Role: FOLLOWER
I20260811 01:31:18.546917 28824 consensus_queue.cc:260] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.548182 28655 heartbeater.cc:503] Master 127.23.39.254:44159 was elected leader, sending a full tablet report...
I20260811 01:31:18.548761 28824 ts_tablet_manager.cc:1428] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260811 01:31:18.549775 28825 raft_consensus.cc:348] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.550343 28825 raft_consensus.cc:374] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:18.550451 28825 raft_consensus.cc:729] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fad06ccbeb05419b8b29ad797aec3fb5, State: Initialized, Role: FOLLOWER
I20260811 01:31:18.551103 28825 consensus_queue.cc:260] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.552217 28826 raft_consensus.cc:348] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.552623 28826 raft_consensus.cc:374] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:18.552722 28826 raft_consensus.cc:729] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 111cc0d7cdbe467f8101d671d98784de, State: Initialized, Role: FOLLOWER
I20260811 01:31:18.553114 28825 ts_tablet_manager.cc:1428] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260811 01:31:18.553371 28826 consensus_queue.cc:260] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.554669 28804 heartbeater.cc:503] Master 127.23.39.254:44159 was elected leader, sending a full tablet report...
I20260811 01:31:18.555279 28826 ts_tablet_manager.cc:1428] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Time spent starting tablet: real 0.015s user 0.007s sys 0.007s
W20260811 01:31:18.629370 28656 tablet.cc:2369] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:31:18.672847 28805 tablet.cc:2369] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:31:18.727672 28832 raft_consensus.cc:482] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:18.728188 28832 raft_consensus.cc:504] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.730157 28832 leader_election.cc:288] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 111cc0d7cdbe467f8101d671d98784de (127.23.39.195:34179), fad06ccbeb05419b8b29ad797aec3fb5 (127.23.39.193:33613)
I20260811 01:31:18.737490 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.730762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:36133 (local address 127.23.39.193:33613)
0811 01:31:18.731025 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.731034 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.731847 (+ 813us) server_negotiation.cc:407] Connection header received
0811 01:31:18.732109 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.732115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.732197 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.732315 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:18.732996 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.733732 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.735678 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.736428 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.736663 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.736759 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.737072 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.737207 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:31:18.737511 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.730557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:46627 (local address 127.23.39.195:34179)
0811 01:31:18.730788 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.730794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.731657 (+ 863us) server_negotiation.cc:407] Connection header received
0811 01:31:18.731852 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.731858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.731950 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.732056 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:18.732782 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.733604 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.735632 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.736438 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.736690 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.736769 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.737109 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.737242 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:31:18.737694 28836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.730555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33613 (local address 127.23.39.194:36133)
0811 01:31:18.731690 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.731710 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.731900 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.732353 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.732357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.732383 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:18.732824 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.732836 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.733882 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.733886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.735485 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.735497 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.736704 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.736711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.736893 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.736934 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.737012 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.737181 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"mutex_wait_us":346,"thread_start_us":501,"threads_started":1}
I20260811 01:31:18.737970 28835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.730546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34179 (local address 127.23.39.194:46627)
0811 01:31:18.731526 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:18.731543 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:18.731685 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:18.732102 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:18.732106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:18.732135 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:18.732609 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.732623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.733752 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.733758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.735470 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:18.735482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.736751 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.736759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:18.736928 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.736951 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:31:18.737061 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:31:18.737193 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"mutex_wait_us":14,"thread_start_us":484,"threads_started":1}
I20260811 01:31:18.738731 28448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c0edc9c6b04cb39ac985fe4ad43b97" candidate_uuid: "0136220ab92548b1a8048ffb74f2a777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" is_pre_election: true
I20260811 01:31:18.738920 28752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c0edc9c6b04cb39ac985fe4ad43b97" candidate_uuid: "0136220ab92548b1a8048ffb74f2a777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "111cc0d7cdbe467f8101d671d98784de" is_pre_election: true
I20260811 01:31:18.739336 28448 raft_consensus.cc:2454] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0136220ab92548b1a8048ffb74f2a777 in term 0.
I20260811 01:31:18.739428 28752 raft_consensus.cc:2454] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0136220ab92548b1a8048ffb74f2a777 in term 0.
I20260811 01:31:18.740151 28530 leader_election.cc:302] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0136220ab92548b1a8048ffb74f2a777, 111cc0d7cdbe467f8101d671d98784de, fad06ccbeb05419b8b29ad797aec3fb5; no voters:
I20260811 01:31:18.740609 28832 raft_consensus.cc:2781] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:18.740761 28832 raft_consensus.cc:482] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:18.740888 28832 raft_consensus.cc:3037] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:18.743721 28832 raft_consensus.cc:504] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.744441 28832 leader_election.cc:288] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [CANDIDATE]: Term 1 election: Requested vote from peers 111cc0d7cdbe467f8101d671d98784de (127.23.39.195:34179), fad06ccbeb05419b8b29ad797aec3fb5 (127.23.39.193:33613)
I20260811 01:31:18.745028 28448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c0edc9c6b04cb39ac985fe4ad43b97" candidate_uuid: "0136220ab92548b1a8048ffb74f2a777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fad06ccbeb05419b8b29ad797aec3fb5"
I20260811 01:31:18.745072 28752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c0edc9c6b04cb39ac985fe4ad43b97" candidate_uuid: "0136220ab92548b1a8048ffb74f2a777" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "111cc0d7cdbe467f8101d671d98784de"
I20260811 01:31:18.745293 28752 raft_consensus.cc:3037] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:18.745290 28448 raft_consensus.cc:3037] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:18.747735 28752 raft_consensus.cc:2454] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0136220ab92548b1a8048ffb74f2a777 in term 1.
I20260811 01:31:18.747879 28448 raft_consensus.cc:2454] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0136220ab92548b1a8048ffb74f2a777 in term 1.
I20260811 01:31:18.748311 28529 leader_election.cc:302] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0136220ab92548b1a8048ffb74f2a777, 111cc0d7cdbe467f8101d671d98784de; no voters:
I20260811 01:31:18.748682 28832 raft_consensus.cc:2781] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:18.749135 28832 raft_consensus.cc:686] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 1 LEADER]: Becoming Leader. State: Replica: 0136220ab92548b1a8048ffb74f2a777, State: Running, Role: LEADER
I20260811 01:31:18.749747 28832 consensus_queue.cc:237] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } }
I20260811 01:31:18.754554 28285 catalog_manager.cc:5495] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0136220ab92548b1a8048ffb74f2a777 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "0136220ab92548b1a8048ffb74f2a777" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0136220ab92548b1a8048ffb74f2a777" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 40137 } health_report { overall_health: HEALTHY } } }
W20260811 01:31:18.797060 28505 tablet.cc:2369] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:31:18.811362 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.805979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.23.39.194:40137)
0811 01:31:18.806240 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.806247 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.806281 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:31:18.806376 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.806380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.806470 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.806602 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:18.806957 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.807681 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.809068 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.809494 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.809594 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.810082 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:18.810727 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:18.810846 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.810947 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.811020 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:31:18.819918 28752 raft_consensus.cc:1261] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 1 FOLLOWER]: Refusing update from remote peer 0136220ab92548b1a8048ffb74f2a777: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:18.819918 28448 raft_consensus.cc:1261] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 1 FOLLOWER]: Refusing update from remote peer 0136220ab92548b1a8048ffb74f2a777: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:18.820994 28837 consensus_queue.cc:1035] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [LEADER]: Connected to new peer: Peer: permanent_uuid: "111cc0d7cdbe467f8101d671d98784de" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:18.821367 28832 consensus_queue.cc:1035] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fad06ccbeb05419b8b29ad797aec3fb5" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:18.834626 28842 mvcc.cc:205] Tried to move back new op lower bound from 7317143055635947520 to 7317143055363211264. Current Snapshot: MvccSnapshot[applied={T|T < 7317143055635947520}]
I20260811 01:31:18.836452 28841 mvcc.cc:205] Tried to move back new op lower bound from 7317143055635947520 to 7317143055363211264. Current Snapshot: MvccSnapshot[applied={T|T < 7317143055635947520}]
I20260811 01:31:18.852607 28284 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:18.852994 28284 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:18.857798 28284 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f1376c72e2924881ba04cb3cfc78a9df: Sending DeleteTablet for 3 replicas of tablet 11c0edc9c6b04cb39ac985fe4ad43b97
I20260811 01:31:18.859282 28428 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:38206
I20260811 01:31:18.859247 28731 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:35826
I20260811 01:31:18.859282 28579 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c0edc9c6b04cb39ac985fe4ad43b97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:46472
I20260811 01:31:18.860961 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28358
I20260811 01:31:18.874365 28857 tablet_replica.cc:330] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: stopping tablet replica
I20260811 01:31:18.874961 28857 raft_consensus.cc:2229] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:18.876485 28854 tablet_replica.cc:330] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: stopping tablet replica
I20260811 01:31:18.877005 28854 raft_consensus.cc:2229] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:18.877643 28854 raft_consensus.cc:2258] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:18.875768 28857 raft_consensus.cc:2258] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:18.885629 28857 ts_tablet_manager.cc:1905] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:18.886456 28854 ts_tablet_manager.cc:1905] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:18.894701 28855 tablet_replica.cc:330] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: stopping tablet replica
I20260811 01:31:18.895323 28855 raft_consensus.cc:2229] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:18.895932 28855 raft_consensus.cc:2258] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 11 01:31:18 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:18.898487 28855 ts_tablet_manager.cc:1905] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:18.899420 28857 ts_tablet_manager.cc:1918] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:18.899605 28857 log.cc:1196] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/11c0edc9c6b04cb39ac985fe4ad43b97
I20260811 01:31:18.900202 28857 ts_tablet_manager.cc:1939] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 0136220ab92548b1a8048ffb74f2a777: Deleting consensus metadata
I20260811 01:31:18.900206 28854 ts_tablet_manager.cc:1918] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:18.900401 28854 log.cc:1196] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/11c0edc9c6b04cb39ac985fe4ad43b97
I20260811 01:31:18.900875 28854 ts_tablet_manager.cc:1939] T 11c0edc9c6b04cb39ac985fe4ad43b97 P fad06ccbeb05419b8b29ad797aec3fb5: Deleting consensus metadata
I20260811 01:31:18.902281 28265 catalog_manager.cc:4841] TS 0136220ab92548b1a8048ffb74f2a777 (127.23.39.194:40137): tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (table test-table [id=5387f2f794a74391855ae8f1bfac964e]) successfully deleted
I20260811 01:31:18.902402 28270 catalog_manager.cc:4841] TS fad06ccbeb05419b8b29ad797aec3fb5 (127.23.39.193:33613): tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (table test-table [id=5387f2f794a74391855ae8f1bfac964e]) successfully deleted
I20260811 01:31:18.905957 28855 ts_tablet_manager.cc:1918] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:18.910445 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:18.862219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.23.39.193:33613)
0811 01:31:18.862464 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:18.862474 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:18.872909 (+ 10435us) server_negotiation.cc:407] Connection header received
0811 01:31:18.873186 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:18.873195 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:18.873353 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:18.873517 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:18.877431 (+ 3914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.879181 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.887150 (+ 7969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:18.888102 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:18.888267 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:18.903951 (+ 15684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:18.903968 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:18.903986 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:18.904043 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:18.907334 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.908142 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.908150 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.908152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.908305 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:18.908742 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:18.908746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:18.908748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:18.909129 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:18.909479 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:18.909779 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 01:31:18.910018 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 01:31:18.911243 28497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:18.912109 28855 log.cc:1196] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/11c0edc9c6b04cb39ac985fe4ad43b97
I20260811 01:31:18.912814 28855 ts_tablet_manager.cc:1939] T 11c0edc9c6b04cb39ac985fe4ad43b97 P 111cc0d7cdbe467f8101d671d98784de: Deleting consensus metadata
I20260811 01:31:18.915002 28268 catalog_manager.cc:4841] TS 111cc0d7cdbe467f8101d671d98784de (127.23.39.195:34179): tablet 11c0edc9c6b04cb39ac985fe4ad43b97 (table test-table [id=5387f2f794a74391855ae8f1bfac964e]) successfully deleted
I20260811 01:31:19.026446 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28358
I20260811 01:31:19.049131 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28510
Aug 11 01:31:19 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:19.068507 28823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:19.050094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46488 (local address 127.23.39.194:40137)
0811 01:31:19.050312 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:19.050317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:19.050354 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:31:19.050581 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:19.050585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:19.050652 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:19.050736 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:19.052500 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:19.053332 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:19.055376 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:19.056002 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:19.056111 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:19.061678 (+ 5567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:19.061698 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:19.061716 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:19.061764 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:19.065250 (+ 3486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:19.066122 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:19.066179 (+ 57us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:19.066182 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:19.066371 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:19.066831 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:19.066838 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:19.066846 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:19.067206 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:19.067611 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:19.067840 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 01:31:19.068107 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 01:31:19.069284 28650 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:19.188836 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28510
I20260811 01:31:19.211669 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28661
Aug 11 01:31:19 dist-test-slave-9jjr krb5kdc[28234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:19.228235 28819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:19.212476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35834 (local address 127.23.39.195:34179)
0811 01:31:19.212683 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:19.212687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:19.212707 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:31:19.212843 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:19.212847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:19.212913 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:19.213015 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:19.214423 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:19.215434 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:19.216927 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:19.217370 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:19.217474 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:19.222475 (+ 5001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:19.222492 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:19.222508 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:19.222550 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:19.225546 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:19.226380 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:19.226387 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:19.226389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:19.226528 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:19.226911 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:19.226914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:19.226916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:19.227271 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:19.227497 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:19.227786 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:31:19.227959 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:31:19.228941 28799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:19.320451 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28661
I20260811 01:31:19.346108 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28247
I20260811 01:31:19.347440 28322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:19.470211 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28247
2026-08-11T01:31:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4726 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T01:31:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:19Z Disabled control of system clock
I20260811 01:31:19.553905 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36655
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:31:19.896283 28868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:19.896611 28868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:19.896728 28868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:19.905129 28868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:19.905256 28868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:19.905293 28868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:19.905354 28868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:19.905397 28868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:19.914867 28868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36655
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:19.916193 28868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:19.917995 28868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:19.930362 28875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:19.930467 28874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:19.930444 28878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:19.931151 28868 server_base.cc:1034] running on GCE node
I20260811 01:31:19.932039 28868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:19.933485 28868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:19.934727 28868 hybrid_clock.cc:648] HybridClock initialized: now 1786411879934695 us; error 65 us; skew 500 ppm
I20260811 01:31:19.935097 28868 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:19.937626 28868 webserver.cc:460] Webserver started at http://127.23.39.254:37755/ using document root <none> and password file <none>
I20260811 01:31:19.938427 28868 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:19.938563 28868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:19.938907 28868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:19.941936 28868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "19a8660e241e4eba942728fab962870c"
format_stamp: "Formatted at 2026-08-11 01:31:19 on dist-test-slave-9jjr"
server_key: "79991eabbf1920af2c1a4535a17cadf4"
server_key_iv: "1138783d1abc82afd7fd2f18cc2ecec2"
server_key_version: "encryptionkey@0"
I20260811 01:31:19.942842 28868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "19a8660e241e4eba942728fab962870c"
format_stamp: "Formatted at 2026-08-11 01:31:19 on dist-test-slave-9jjr"
server_key: "79991eabbf1920af2c1a4535a17cadf4"
server_key_iv: "1138783d1abc82afd7fd2f18cc2ecec2"
server_key_version: "encryptionkey@0"
I20260811 01:31:19.948665 28868 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:19.952404 28884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:19.953835 28868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:19.954034 28868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "19a8660e241e4eba942728fab962870c"
format_stamp: "Formatted at 2026-08-11 01:31:19 on dist-test-slave-9jjr"
server_key: "79991eabbf1920af2c1a4535a17cadf4"
server_key_iv: "1138783d1abc82afd7fd2f18cc2ecec2"
server_key_version: "encryptionkey@0"
I20260811 01:31:19.954324 28868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:19.960078 28868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:19.960882 28868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:19.961184 28868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:19.979825 28868 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:36655
I20260811 01:31:19.979859 28942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:36655 every 8 connection(s)
I20260811 01:31:19.981182 28868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:19.984967 28943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:19.987740 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28868
I20260811 01:31:19.987932 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:19.988610 23711 external_mini_cluster.cc:1428] Setting key 53b3348195330a8506306f1f8b5687de
I20260811 01:31:19.998083 28947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:19.990771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60034 (local address 127.23.39.254:36655)
0811 01:31:19.991805 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:19.991821 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:19.991873 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:31:19.993997 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:19.994032 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:19.994605 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:19.995046 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:19.996086 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:19.996095 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:19.996110 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:19.996128 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:19.996211 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:19.996232 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:19.996466 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:19.996617 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:31:19.996886 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":328,"threads_started":1}
I20260811 01:31:19.998756 28943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: Bootstrap starting.
I20260811 01:31:20.001839 28943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:20.002892 28943 log.cc:824] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:20.005818 28943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: No bootstrap required, opened a new log
I20260811 01:31:20.013441 28943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } }
I20260811 01:31:20.013888 28943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:20.013998 28943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a8660e241e4eba942728fab962870c, State: Initialized, Role: FOLLOWER
I20260811 01:31:20.014708 28943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } }
I20260811 01:31:20.014956 28943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:20.015108 28943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:20.015300 28943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:20.017951 28943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } }
I20260811 01:31:20.018497 28943 leader_election.cc:302] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19a8660e241e4eba942728fab962870c; no voters:
I20260811 01:31:20.019140 28943 leader_election.cc:288] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:20.019312 28949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:20.020181 28949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [term 1 LEADER]: Becoming Leader. State: Replica: 19a8660e241e4eba942728fab962870c, State: Running, Role: LEADER
I20260811 01:31:20.020872 28949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } }
I20260811 01:31:20.021649 28943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:20.023783 28950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19a8660e241e4eba942728fab962870c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } } }
I20260811 01:31:20.023875 28951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19a8660e241e4eba942728fab962870c. Latest consensus state: current_term: 1 leader_uuid: "19a8660e241e4eba942728fab962870c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8660e241e4eba942728fab962870c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36655 } } }
I20260811 01:31:20.024292 28951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:20.024289 28950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:20.030925 28957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:20.036152 28957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:20.044267 28957 catalog_manager.cc:1347] Generated new cluster ID: bcdb8f1fee884813ad3a53b9833135cb
I20260811 01:31:20.044406 28957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:20.062026 28957 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:20.062500 28957 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:20.074630 28957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: Generated new TSK 0
I20260811 01:31:20.075518 28957 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:31:20.087423 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--builtin_ntp_servers=127.23.39.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 01:31:20.454234 28969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:20.454527 28969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:20.454702 28969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:20.462342 28969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:20.462466 28969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:20.462656 28969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:20.472371 28969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:20.473783 28969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:20.475765 28969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:20.489319 28974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:20.489295 28976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:20.489255 28978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:20.490238 28969 server_base.cc:1034] running on GCE node
I20260811 01:31:20.490939 28969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:20.491905 28969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:20.493129 28969 hybrid_clock.cc:648] HybridClock initialized: now 1786411880493054 us; error 71 us; skew 500 ppm
I20260811 01:31:20.493449 28969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:20.495882 28969 webserver.cc:460] Webserver started at http://127.23.39.193:39509/ using document root <none> and password file <none>
I20260811 01:31:20.496598 28969 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:20.496747 28969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:20.497092 28969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:20.500105 28969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "ad34abc07d4d4b46ada03798587ffbc7"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "c5271de86e84852a73dc914dfb266620"
server_key_iv: "8568fcd3b8e77ef44573d7236f6c7da6"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.500948 28969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "ad34abc07d4d4b46ada03798587ffbc7"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "c5271de86e84852a73dc914dfb266620"
server_key_iv: "8568fcd3b8e77ef44573d7236f6c7da6"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.506656 28969 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:31:20.510329 28986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:20.511649 28969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:20.511829 28969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "ad34abc07d4d4b46ada03798587ffbc7"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "c5271de86e84852a73dc914dfb266620"
server_key_iv: "8568fcd3b8e77ef44573d7236f6c7da6"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.512073 28969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:20.518252 28969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:20.519104 28969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:20.519405 28969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:20.520344 28969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:20.521845 28969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:20.521973 28969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:20.522113 28969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:20.522286 28969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 01:31:20.556442 28969 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:43453
I20260811 01:31:20.556502 29110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:43453 every 8 connection(s)
I20260811 01:31:20.557827 28969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:20.566555 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:20.560604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:57865 (local address 127.23.39.254:36655)
0811 01:31:20.561141 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:20.561146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:20.562383 (+ 1237us) server_negotiation.cc:407] Connection header received
0811 01:31:20.564214 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:20.564220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:20.564294 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:20.564428 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:20.565776 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:20.565783 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:20.565787 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:20.565815 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:20.565861 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:20.565873 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:20.566017 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:20.566257 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:31:20.566318 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":281,"threads_started":1}
I20260811 01:31:20.566653 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 28969
I20260811 01:31:20.566869 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:20.567727 23711 external_mini_cluster.cc:1428] Setting key ef0d37c244aeaf0059f6bb67d10c4c0a
I20260811 01:31:20.567970 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:20.561241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36655 (local address 127.23.39.193:57865)
0811 01:31:20.562201 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:20.562246 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:20.563921 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:20.564689 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:20.564698 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:20.564794 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:20.565444 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:20.565446 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:20.565487 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:20.565583 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:20.565975 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:20.565988 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:20.565998 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:31:20.566344 (+ 346us) client_negotiation.cc:240] Negotiation successful
0811 01:31:20.566642 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":277,"threads_started":1}
I20260811 01:31:20.569689 29111 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36655
I20260811 01:31:20.570037 29111 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:20.570833 29111 heartbeater.cc:511] Master 127.23.39.254:36655 requested a full tablet report, sending...
I20260811 01:31:20.571416 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--builtin_ntp_servers=127.23.39.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:31:20.573086 28901 ts_manager.cc:194] Registered new tserver with Master: ad34abc07d4d4b46ada03798587ffbc7 (127.23.39.193:43453)
W20260811 01:31:20.920058 29118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:20.920431 29118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:20.920599 29118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:20.928114 29118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:20.928257 29118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:20.928448 29118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:20.938063 29118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:20.939558 29118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:20.941416 29118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:20.954993 29124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:20.955163 29126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:20.955127 29123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:20.956176 29118 server_base.cc:1034] running on GCE node
I20260811 01:31:20.956882 29118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:20.957904 29118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:20.959105 29118 hybrid_clock.cc:648] HybridClock initialized: now 1786411880959033 us; error 58 us; skew 500 ppm
I20260811 01:31:20.959482 29118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:20.961822 29118 webserver.cc:460] Webserver started at http://127.23.39.194:42339/ using document root <none> and password file <none>
I20260811 01:31:20.962616 29118 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:20.962742 29118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:20.963109 29118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:20.966439 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "f61364af188d412d804b93024c552577"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "a57b8880bff7866d9eac4bec4629123d"
server_key_iv: "8598ed2c1146bf0aebc3e95c826b4594"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.967572 29118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "f61364af188d412d804b93024c552577"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "a57b8880bff7866d9eac4bec4629123d"
server_key_iv: "8598ed2c1146bf0aebc3e95c826b4594"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.973150 29118 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:31:20.976985 29134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:20.978641 29118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:20.978833 29118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "f61364af188d412d804b93024c552577"
format_stamp: "Formatted at 2026-08-11 01:31:20 on dist-test-slave-9jjr"
server_key: "a57b8880bff7866d9eac4bec4629123d"
server_key_iv: "8598ed2c1146bf0aebc3e95c826b4594"
server_key_version: "encryptionkey@0"
I20260811 01:31:20.979091 29118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:20.985018 29118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:20.985857 29118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:20.986271 29118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:20.987260 29118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:20.988727 29118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:20.988814 29118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:20.988965 29118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:20.989058 29118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:21.023959 29118 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:39921
I20260811 01:31:21.024010 29261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:39921 every 8 connection(s)
I20260811 01:31:21.025341 29118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:21.027122 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29118
I20260811 01:31:21.027288 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:21.027791 23711 external_mini_cluster.cc:1428] Setting key 8f51a2aa95ddac47b48661c66c033817
I20260811 01:31:21.030752 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--builtin_ntp_servers=127.23.39.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 01:31:21.034561 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.028240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:47425 (local address 127.23.39.254:36655)
0811 01:31:21.028466 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.028472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.030086 (+ 1614us) server_negotiation.cc:407] Connection header received
0811 01:31:21.032184 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.032193 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.032279 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.032394 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.033707 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.033716 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.033723 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.033745 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.033798 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.033818 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.033942 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.034114 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.034204 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:31:21.035429 29264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.028820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36655 (local address 127.23.39.194:47425)
0811 01:31:21.029923 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.029968 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.031878 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.032588 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.032596 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.032688 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.033407 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.033410 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.033448 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.033533 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.033918 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.033926 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.033931 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.034210 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.034411 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":359,"threads_started":1}
I20260811 01:31:21.036933 29262 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36655
I20260811 01:31:21.037266 29262 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:21.037878 29262 heartbeater.cc:511] Master 127.23.39.254:36655 requested a full tablet report, sending...
I20260811 01:31:21.039393 28901 ts_manager.cc:194] Registered new tserver with Master: f61364af188d412d804b93024c552577 (127.23.39.194:39921)
W20260811 01:31:21.378937 29266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:21.379230 29266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:21.379405 29266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:21.387004 29266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:21.387112 29266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:21.387292 29266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:21.396668 29266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:21.398056 29266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:21.399994 29266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:21.413938 29275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:21.414022 29271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:21.414026 29273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:21.414934 29266 server_base.cc:1034] running on GCE node
I20260811 01:31:21.415671 29266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:21.416775 29266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:21.418020 29266 hybrid_clock.cc:648] HybridClock initialized: now 1786411881417973 us; error 50 us; skew 500 ppm
I20260811 01:31:21.418411 29266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:21.420825 29266 webserver.cc:460] Webserver started at http://127.23.39.195:35243/ using document root <none> and password file <none>
I20260811 01:31:21.421576 29266 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:21.421720 29266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:21.422118 29266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:21.425346 29266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "e435dea7fa584ca5a1625b13f69aebae"
format_stamp: "Formatted at 2026-08-11 01:31:21 on dist-test-slave-9jjr"
server_key: "b98982b162330c8f5f5f0ac487bb2fa6"
server_key_iv: "fa16cd1166d3b61c74418aeae09e181f"
server_key_version: "encryptionkey@0"
I20260811 01:31:21.426349 29266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "e435dea7fa584ca5a1625b13f69aebae"
format_stamp: "Formatted at 2026-08-11 01:31:21 on dist-test-slave-9jjr"
server_key: "b98982b162330c8f5f5f0ac487bb2fa6"
server_key_iv: "fa16cd1166d3b61c74418aeae09e181f"
server_key_version: "encryptionkey@0"
I20260811 01:31:21.433270 29266 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:31:21.437150 29281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:21.438694 29266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:21.438896 29266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "e435dea7fa584ca5a1625b13f69aebae"
format_stamp: "Formatted at 2026-08-11 01:31:21 on dist-test-slave-9jjr"
server_key: "b98982b162330c8f5f5f0ac487bb2fa6"
server_key_iv: "fa16cd1166d3b61c74418aeae09e181f"
server_key_version: "encryptionkey@0"
I20260811 01:31:21.439152 29266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:21.445322 29266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:21.446365 29266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:21.446659 29266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:21.447669 29266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:21.449241 29266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:21.449364 29266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:21.449504 29266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:21.449594 29266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:21.485258 29266 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46739
I20260811 01:31:21.485276 29407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46739 every 8 connection(s)
I20260811 01:31:21.486732 29266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:21.487190 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29266
I20260811 01:31:21.487406 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:21.488086 23711 external_mini_cluster.cc:1428] Setting key 93a3a89b481926a5757520eead91058c
I20260811 01:31:21.495990 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.489471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:48121 (local address 127.23.39.254:36655)
0811 01:31:21.489722 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.489726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.491797 (+ 2071us) server_negotiation.cc:407] Connection header received
0811 01:31:21.493634 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.493638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.493706 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.493792 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.495334 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.495338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.495342 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.495369 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.495404 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.495416 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.495523 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.495705 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.495761 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:31:21.497088 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.490260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36655 (local address 127.23.39.195:48121)
0811 01:31:21.491594 (+ 1334us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.491666 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.493375 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.494029 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.494038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.494205 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.495016 (+ 811us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.495019 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.495063 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.495157 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.495510 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.495518 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.495524 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.495770 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.495987 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":387,"threads_started":1}
I20260811 01:31:21.498560 29408 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36655
I20260811 01:31:21.498904 29408 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:21.499585 29408 heartbeater.cc:511] Master 127.23.39.254:36655 requested a full tablet report, sending...
I20260811 01:31:21.501124 28901 ts_manager.cc:194] Registered new tserver with Master: e435dea7fa584ca5a1625b13f69aebae (127.23.39.195:46739)
I20260811 01:31:21.504335 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:31:21.512053 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.509113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.23.39.254:36655)
0811 01:31:21.509304 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.509308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.509972 (+ 664us) server_negotiation.cc:407] Connection header received
0811 01:31:21.510250 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.510255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.510311 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.510394 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.511454 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.511457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.511460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.511473 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.511500 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.511511 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.511641 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.511691 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.511759 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:31:21.516842 28901 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:21.523983 28901 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:21.543669 29424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.536596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39946)
0811 01:31:21.538515 (+ 1919us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.538577 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.538744 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.540784 (+ 2040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.540790 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.540871 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.541807 (+ 936us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.541810 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.541844 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.541940 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.542629 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.542646 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.542657 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.542831 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.542924 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1544,"thread_start_us":5044,"threads_started":1}
I20260811 01:31:21.544711 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.536751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39946 (local address 127.23.39.193:43453)
0811 01:31:21.540051 (+ 3300us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.540064 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.540103 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:31:21.540199 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.540211 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.540548 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.540752 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.542336 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.542349 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.542368 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.542388 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.542456 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.542484 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.543822 (+ 1338us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.543942 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.544358 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3098,"thread_start_us":2945,"threads_started":1}
I20260811 01:31:21.545583 29422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.537361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46739 (local address 127.0.0.1:58814)
0811 01:31:21.542232 (+ 4871us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.542253 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.542441 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.543161 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.543166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.543190 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.544065 (+ 875us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.544068 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.544085 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.544133 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.544637 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.544642 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.544647 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.544783 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.545054 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4731,"thread_start_us":546,"threads_started":1}
I20260811 01:31:21.546515 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.537918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58814 (local address 127.23.39.195:46739)
0811 01:31:21.539513 (+ 1595us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.539527 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.542353 (+ 2826us) server_negotiation.cc:407] Connection header received
0811 01:31:21.542623 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.542632 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.542875 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.543030 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.544398 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.544406 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.544418 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.544435 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.544485 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.544504 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.545887 (+ 1383us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.545961 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.546063 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1352,"thread_start_us":1127,"threads_started":1}
I20260811 01:31:21.548007 29424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.542111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39921 (local address 127.0.0.1:40882)
0811 01:31:21.544013 (+ 1902us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.544030 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.544108 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.545075 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.545084 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.545150 (+ 66us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.545947 (+ 797us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.545953 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.545976 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.546037 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.547612 (+ 1575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.547617 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.547622 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.547718 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.547771 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1789,"threads_started":1}
I20260811 01:31:21.548355 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.542387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40882 (local address 127.23.39.194:39921)
0811 01:31:21.543030 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.543040 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.544229 (+ 1189us) server_negotiation.cc:407] Connection header received
0811 01:31:21.544341 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.544353 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.544612 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.545531 (+ 919us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.547340 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.547352 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.547369 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.547401 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.547466 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.547492 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.547664 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.547753 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.547867 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":321,"threads_started":1}
I20260811 01:31:21.550314 29332 tablet_service.cc:1467] Processing CreateTablet for tablet d139712aeaf7430bbe7a2a32285e435b (DEFAULT_TABLE table=test-table [id=30467922c0c84bb686b693728fd2eea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:21.551636 29332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d139712aeaf7430bbe7a2a32285e435b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:21.552561 29189 tablet_service.cc:1467] Processing CreateTablet for tablet d139712aeaf7430bbe7a2a32285e435b (DEFAULT_TABLE table=test-table [id=30467922c0c84bb686b693728fd2eea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:21.552561 29039 tablet_service.cc:1467] Processing CreateTablet for tablet d139712aeaf7430bbe7a2a32285e435b (DEFAULT_TABLE table=test-table [id=30467922c0c84bb686b693728fd2eea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:21.553968 29189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d139712aeaf7430bbe7a2a32285e435b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:21.553963 29039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d139712aeaf7430bbe7a2a32285e435b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:21.572772 29429 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Bootstrap starting.
I20260811 01:31:21.574096 29430 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: Bootstrap starting.
I20260811 01:31:21.576399 29111 heartbeater.cc:503] Master 127.23.39.254:36655 was elected leader, sending a full tablet report...
I20260811 01:31:21.576957 29429 tablet_bootstrap.cc:654] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:21.577687 29428 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Bootstrap starting.
I20260811 01:31:21.578354 29429 log.cc:824] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:21.580178 29430 tablet_bootstrap.cc:654] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:21.581571 29430 log.cc:824] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:21.582185 29428 tablet_bootstrap.cc:654] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:21.583758 29428 log.cc:824] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:21.585785 29429 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: No bootstrap required, opened a new log
I20260811 01:31:21.585932 29430 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: No bootstrap required, opened a new log
I20260811 01:31:21.586092 29429 ts_tablet_manager.cc:1397] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260811 01:31:21.586218 29430 ts_tablet_manager.cc:1397] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260811 01:31:21.586927 29428 tablet_bootstrap.cc:492] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: No bootstrap required, opened a new log
I20260811 01:31:21.587208 29428 ts_tablet_manager.cc:1397] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 01:31:21.594282 29428 raft_consensus.cc:348] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.594743 29428 raft_consensus.cc:374] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:21.594851 29428 raft_consensus.cc:729] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e435dea7fa584ca5a1625b13f69aebae, State: Initialized, Role: FOLLOWER
I20260811 01:31:21.595593 29428 consensus_queue.cc:260] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.597363 29429 raft_consensus.cc:348] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.597363 29430 raft_consensus.cc:348] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.597851 29429 raft_consensus.cc:374] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:21.597857 29430 raft_consensus.cc:374] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:21.597959 29429 raft_consensus.cc:729] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f61364af188d412d804b93024c552577, State: Initialized, Role: FOLLOWER
I20260811 01:31:21.597958 29430 raft_consensus.cc:729] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad34abc07d4d4b46ada03798587ffbc7, State: Initialized, Role: FOLLOWER
I20260811 01:31:21.598670 29429 consensus_queue.cc:260] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.598665 29430 consensus_queue.cc:260] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.599076 29408 heartbeater.cc:503] Master 127.23.39.254:36655 was elected leader, sending a full tablet report...
I20260811 01:31:21.599829 29428 ts_tablet_manager.cc:1428] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260811 01:31:21.600997 29262 heartbeater.cc:503] Master 127.23.39.254:36655 was elected leader, sending a full tablet report...
I20260811 01:31:21.602741 29430 ts_tablet_manager.cc:1428] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: Time spent starting tablet: real 0.016s user 0.009s sys 0.007s
I20260811 01:31:21.603332 29429 ts_tablet_manager.cc:1428] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Time spent starting tablet: real 0.017s user 0.008s sys 0.007s
I20260811 01:31:21.667163 29434 raft_consensus.cc:482] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:21.667538 29434 raft_consensus.cc:504] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.669323 29434 leader_election.cc:288] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad34abc07d4d4b46ada03798587ffbc7 (127.23.39.193:43453), f61364af188d412d804b93024c552577 (127.23.39.194:39921)
I20260811 01:31:21.672617 29410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.669749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.23.39.195:58973)
0811 01:31:21.670001 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.670026 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.670185 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.670784 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.670792 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.670829 (+ 37us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.671588 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.671591 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.671606 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.671672 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.672152 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.672157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.672162 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.672286 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.672346 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:31:21.672688 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.669857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:58973 (local address 127.23.39.193:43453)
0811 01:31:21.670058 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.670066 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.670091 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:21.670381 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.670387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.670465 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.670573 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.671870 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.671877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.671885 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.671906 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.671946 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.671968 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.672104 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.672305 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.672377 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:31:21.673429 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.670636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:37603 (local address 127.23.39.194:39921)
0811 01:31:21.671129 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.671138 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.671336 (+ 198us) server_negotiation.cc:407] Connection header received
0811 01:31:21.671500 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.671507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.671571 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.671679 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.672751 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.672757 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.672771 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.672795 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.672836 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.672854 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.672968 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.673092 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.673157 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355}
I20260811 01:31:21.673712 29437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.670309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39921 (local address 127.23.39.195:37603)
0811 01:31:21.671224 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.671250 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:21.671365 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:21.671730 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:21.671736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:21.671761 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:21.672453 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:31:21.672457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:21.672473 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:31:21.672525 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:21.672956 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:21.672963 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:21.672971 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:31:21.673110 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 01:31:21.673264 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":541,"threads_started":1}
I20260811 01:31:21.674095 29062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d139712aeaf7430bbe7a2a32285e435b" candidate_uuid: "e435dea7fa584ca5a1625b13f69aebae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34abc07d4d4b46ada03798587ffbc7" is_pre_election: true
I20260811 01:31:21.674779 29062 raft_consensus.cc:2454] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e435dea7fa584ca5a1625b13f69aebae in term 0.
I20260811 01:31:21.674948 29210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d139712aeaf7430bbe7a2a32285e435b" candidate_uuid: "e435dea7fa584ca5a1625b13f69aebae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61364af188d412d804b93024c552577" is_pre_election: true
I20260811 01:31:21.675496 29210 raft_consensus.cc:2454] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e435dea7fa584ca5a1625b13f69aebae in term 0.
I20260811 01:31:21.675547 29284 leader_election.cc:302] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad34abc07d4d4b46ada03798587ffbc7, e435dea7fa584ca5a1625b13f69aebae; no voters:
I20260811 01:31:21.676002 29434 raft_consensus.cc:2781] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:21.676193 29434 raft_consensus.cc:482] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:21.676337 29434 raft_consensus.cc:3037] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:21.678779 29434 raft_consensus.cc:504] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.679298 29434 leader_election.cc:288] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [CANDIDATE]: Term 1 election: Requested vote from peers ad34abc07d4d4b46ada03798587ffbc7 (127.23.39.193:43453), f61364af188d412d804b93024c552577 (127.23.39.194:39921)
I20260811 01:31:21.679826 29062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d139712aeaf7430bbe7a2a32285e435b" candidate_uuid: "e435dea7fa584ca5a1625b13f69aebae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad34abc07d4d4b46ada03798587ffbc7"
I20260811 01:31:21.679862 29210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d139712aeaf7430bbe7a2a32285e435b" candidate_uuid: "e435dea7fa584ca5a1625b13f69aebae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f61364af188d412d804b93024c552577"
I20260811 01:31:21.680052 29062 raft_consensus.cc:3037] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:21.680051 29210 raft_consensus.cc:3037] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:21.683445 29062 raft_consensus.cc:2454] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e435dea7fa584ca5a1625b13f69aebae in term 1.
I20260811 01:31:21.683446 29210 raft_consensus.cc:2454] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e435dea7fa584ca5a1625b13f69aebae in term 1.
I20260811 01:31:21.683949 29284 leader_election.cc:302] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e435dea7fa584ca5a1625b13f69aebae, f61364af188d412d804b93024c552577; no voters:
I20260811 01:31:21.684235 29434 raft_consensus.cc:2781] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:21.684700 29434 raft_consensus.cc:686] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 1 LEADER]: Becoming Leader. State: Replica: e435dea7fa584ca5a1625b13f69aebae, State: Running, Role: LEADER
I20260811 01:31:21.685283 29434 consensus_queue.cc:237] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } }
I20260811 01:31:21.690002 28900 catalog_manager.cc:5495] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae reported cstate change: term changed from 0 to 1, leader changed from <none> to e435dea7fa584ca5a1625b13f69aebae (127.23.39.195). New cstate: current_term: 1 leader_uuid: "e435dea7fa584ca5a1625b13f69aebae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e435dea7fa584ca5a1625b13f69aebae" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46739 } health_report { overall_health: HEALTHY } } }
I20260811 01:31:21.711684 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.709179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.23.39.195:46739)
0811 01:31:21.709394 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.709401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.709524 (+ 123us) server_negotiation.cc:407] Connection header received
0811 01:31:21.709799 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.709803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.709886 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.710003 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.711027 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.711034 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.711039 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.711070 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.711111 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.711124 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.711265 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.711347 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.711413 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:31:21.720952 29210 raft_consensus.cc:1261] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 1 FOLLOWER]: Refusing update from remote peer e435dea7fa584ca5a1625b13f69aebae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:21.720965 29062 raft_consensus.cc:1261] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 1 FOLLOWER]: Refusing update from remote peer e435dea7fa584ca5a1625b13f69aebae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:21.722012 29438 consensus_queue.cc:1035] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad34abc07d4d4b46ada03798587ffbc7" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 43453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:21.722481 29434 consensus_queue.cc:1035] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [LEADER]: Connected to new peer: Peer: permanent_uuid: "f61364af188d412d804b93024c552577" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:21.750377 28901 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:21.750669 28901 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:21.754609 28901 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19a8660e241e4eba942728fab962870c: Sending DeleteTablet for 3 replicas of tablet d139712aeaf7430bbe7a2a32285e435b
I20260811 01:31:21.755977 29189 tablet_service.cc:1514] Processing DeleteTablet for tablet d139712aeaf7430bbe7a2a32285e435b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:21 UTC) from {username='slave'} at 127.0.0.1:40882
I20260811 01:31:21.756042 29332 tablet_service.cc:1514] Processing DeleteTablet for tablet d139712aeaf7430bbe7a2a32285e435b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:21 UTC) from {username='slave'} at 127.0.0.1:58814
I20260811 01:31:21.757223 29039 tablet_service.cc:1514] Processing DeleteTablet for tablet d139712aeaf7430bbe7a2a32285e435b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:21 UTC) from {username='slave'} at 127.0.0.1:39946
I20260811 01:31:21.758044 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28969
I20260811 01:31:21.767463 29452 tablet_replica.cc:330] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: stopping tablet replica
I20260811 01:31:21.768249 29452 raft_consensus.cc:2229] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:21.768991 29452 raft_consensus.cc:2258] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:21.771864 29452 ts_tablet_manager.cc:1905] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:21.781096 29452 ts_tablet_manager.cc:1918] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:21.781973 29453 tablet_replica.cc:330] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: stopping tablet replica
I20260811 01:31:21.782595 29453 raft_consensus.cc:2229] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:21.783541 29453 raft_consensus.cc:2258] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:21.785297 29455 tablet_replica.cc:330] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7: stopping tablet replica
I20260811 01:31:21.785779 29455 raft_consensus.cc:2229] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:21.786478 29455 raft_consensus.cc:2258] T d139712aeaf7430bbe7a2a32285e435b P ad34abc07d4d4b46ada03798587ffbc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:21.786604 29423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.761304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.23.39.193:43453)
0811 01:31:21.761539 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.761549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.783673 (+ 22124us) server_negotiation.cc:407] Connection header received
0811 01:31:21.783871 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.783877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.784010 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.784131 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.785574 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.785581 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.785586 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.785612 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.785656 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.785672 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.785790 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.786177 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.786268 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:31:21.786643 29453 ts_tablet_manager.cc:1905] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:21.787853 29106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:21.791652 29452 log.cc:1196] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/d139712aeaf7430bbe7a2a32285e435b
I20260811 01:31:21.792300 29452 ts_tablet_manager.cc:1939] T d139712aeaf7430bbe7a2a32285e435b P f61364af188d412d804b93024c552577: Deleting consensus metadata
I20260811 01:31:21.794236 29453 ts_tablet_manager.cc:1918] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:21.794418 29453 log.cc:1196] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/d139712aeaf7430bbe7a2a32285e435b
I20260811 01:31:21.794399 28887 catalog_manager.cc:4841] TS f61364af188d412d804b93024c552577 (127.23.39.194:39921): tablet d139712aeaf7430bbe7a2a32285e435b (table test-table [id=30467922c0c84bb686b693728fd2eea6]) successfully deleted
I20260811 01:31:21.794992 29453 ts_tablet_manager.cc:1939] T d139712aeaf7430bbe7a2a32285e435b P e435dea7fa584ca5a1625b13f69aebae: Deleting consensus metadata
I20260811 01:31:21.796777 28886 catalog_manager.cc:4841] TS e435dea7fa584ca5a1625b13f69aebae (127.23.39.195:46739): tablet d139712aeaf7430bbe7a2a32285e435b (table test-table [id=30467922c0c84bb686b693728fd2eea6]) successfully deleted
I20260811 01:31:21.880540 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28969
I20260811 01:31:21.901780 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29118
W20260811 01:31:21.901860 28887 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:43453 (error 108)
I20260811 01:31:21.905105 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.904399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39958)
0811 01:31:21.904638 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.904846 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:31:21.905504 28887 catalog_manager.cc:4584] TS ad34abc07d4d4b46ada03798587ffbc7 (127.23.39.193:43453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d139712aeaf7430bbe7a2a32285e435b: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
I20260811 01:31:21.905931 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.902591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40896 (local address 127.23.39.194:39921)
0811 01:31:21.903662 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:21.903668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:21.903692 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:31:21.903762 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:21.903785 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:21.903922 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:21.904037 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:21.905118 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:21.905126 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:21.905134 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:21.905158 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:21.905202 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:21.905221 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:21.905364 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:21.905572 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 01:31:21.905638 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:31:21.906651 29254 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:21.959280 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.958722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39964)
0811 01:31:21.958968 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.959090 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 01:31:21.960539 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:21.960080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39972)
0811 01:31:21.960248 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:21.960341 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:31:21.998847 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29118
I20260811 01:31:22.021019 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29266
I20260811 01:31:22.021193 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.020699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39984)
0811 01:31:22.020899 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.021010 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:31:22.022538 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.022120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39990)
0811 01:31:22.022284 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.022365 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 01:31:22.024607 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.022049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58824 (local address 127.23.39.195:46739)
0811 01:31:22.022346 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:22.022352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:22.022372 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:31:22.022464 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:22.022469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:22.022547 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:22.022660 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:22.023826 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:22.023832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:22.023835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:22.023851 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:22.023888 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:22.023900 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:22.024020 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:22.024182 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 01:31:22.024235 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260811 01:31:22.025280 29402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:22.103461 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.102821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:39998)
0811 01:31:22.103106 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.103231 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 01:31:22.104641 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.104177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:40014)
0811 01:31:22.104418 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.104507 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260811 01:31:22.147811 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29266
I20260811 01:31:22.170858 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 28868
I20260811 01:31:22.172113 28937 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:22.281172 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.280387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:43453 (local address 127.0.0.1:40030)
0811 01:31:22.280622 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.280786 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:43453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 01:31:22.281154 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 28868
2026-08-11T01:31:22Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2808 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 01:31:22.327999 23711 mini_oidc.cc:152] Starting JWKS server
I20260811 01:31:22.330961 23711 webserver.cc:460] Webserver started at https://127.0.0.1:34245/ using document root <none> and password file <none>
I20260811 01:31:22.331307 23711 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:31:22.331930 23711 webserver.cc:460] Webserver started at http://127.0.0.1:33069/ using document root <none> and password file <none>
2026-08-11T01:31:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:22Z Disabled control of system clock
I20260811 01:31:22.369552 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42973
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:35601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42973
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34245/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/testchainca.cert with env {}
W20260811 01:31:22.706739 29470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:22.707041 29470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:22.707218 29470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:22.714772 29470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:22.714941 29470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:22.715036 29470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:22.715152 29470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:22.715232 29470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:31:22.715345 29470 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:31:22.715416 29470 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34245/jwks.json
I20260811 01:31:22.725795 29470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42973
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34245/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:22.727324 29470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:22.728719 29470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:22.741079 29475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:22.741109 29478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:22.741057 29476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:22.741986 29470 server_base.cc:1034] running on GCE node
I20260811 01:31:22.742841 29470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:22.744359 29470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:22.745564 29470 hybrid_clock.cc:648] HybridClock initialized: now 1786411882745526 us; error 34 us; skew 500 ppm
I20260811 01:31:22.745941 29470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:22.748441 29470 webserver.cc:460] Webserver started at http://127.23.39.254:32913/ using document root <none> and password file <none>
I20260811 01:31:22.749191 29470 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:22.749330 29470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:22.749676 29470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:22.752808 29470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "e9635f211cc245859e62715273d6b50e"
format_stamp: "Formatted at 2026-08-11 01:31:22 on dist-test-slave-9jjr"
server_key: "90bc430e003eb3f4fec1a6842cf10983"
server_key_iv: "902260f1d36858c5b109b710cce7c000"
server_key_version: "encryptionkey@0"
I20260811 01:31:22.753665 29470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "e9635f211cc245859e62715273d6b50e"
format_stamp: "Formatted at 2026-08-11 01:31:22 on dist-test-slave-9jjr"
server_key: "90bc430e003eb3f4fec1a6842cf10983"
server_key_iv: "902260f1d36858c5b109b710cce7c000"
server_key_version: "encryptionkey@0"
I20260811 01:31:22.759099 29470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 01:31:22.762768 29484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:22.764135 29470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:22.764350 29470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "e9635f211cc245859e62715273d6b50e"
format_stamp: "Formatted at 2026-08-11 01:31:22 on dist-test-slave-9jjr"
server_key: "90bc430e003eb3f4fec1a6842cf10983"
server_key_iv: "902260f1d36858c5b109b710cce7c000"
server_key_version: "encryptionkey@0"
I20260811 01:31:22.764582 29470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:22.783937 29470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:22.784839 29470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:22.785171 29470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:22.804805 29470 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42973
I20260811 01:31:22.804829 29540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42973 every 8 connection(s)
I20260811 01:31:22.806272 29470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:22.810119 29541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:22.814172 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29470
I20260811 01:31:22.814417 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:22.815483 23711 external_mini_cluster.cc:1428] Setting key ba9669242a1499ded4eb8cae06db23a9
I20260811 01:31:22.824409 29541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e: Bootstrap starting.
I20260811 01:31:22.827925 29541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:22.829159 29541 log.cc:824] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:22.830168 29545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.817698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45880 (local address 127.23.39.254:42973)
0811 01:31:22.818829 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:22.818840 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:22.818888 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:31:22.820584 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:22.820618 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:22.821148 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:22.821577 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:22.822276 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.823592 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.825107 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.825822 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.826073 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:22.827384 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:22.827393 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:22.827407 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:22.827974 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:22.828133 (+ 159us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:22.828157 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:22.828304 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:22.828526 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 01:31:22.828875 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":459,"threads_started":1}
I20260811 01:31:22.832351 29541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e: No bootstrap required, opened a new log
I20260811 01:31:22.834216 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:31:22.840585 29541 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } }
I20260811 01:31:22.841033 29541 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:22.841154 29541 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9635f211cc245859e62715273d6b50e, State: Initialized, Role: FOLLOWER
I20260811 01:31:22.841816 29541 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } }
I20260811 01:31:22.842079 29541 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:22.842239 29541 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:22.842386 29541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:22.845029 29541 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } }
I20260811 01:31:22.845515 29541 leader_election.cc:302] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9635f211cc245859e62715273d6b50e; no voters:
I20260811 01:31:22.846102 29541 leader_election.cc:288] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:22.846345 29547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:22.847057 29547 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [term 1 LEADER]: Becoming Leader. State: Replica: e9635f211cc245859e62715273d6b50e, State: Running, Role: LEADER
I20260811 01:31:22.847628 29547 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } }
I20260811 01:31:22.848434 29541 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:22.851099 29548 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9635f211cc245859e62715273d6b50e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } } }
I20260811 01:31:22.851087 29549 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9635f211cc245859e62715273d6b50e. Latest consensus state: current_term: 1 leader_uuid: "e9635f211cc245859e62715273d6b50e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9635f211cc245859e62715273d6b50e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42973 } } }
I20260811 01:31:22.851593 29549 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:22.851593 29548 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:22.855175 29554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:22.861886 29554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:22.871408 29554 catalog_manager.cc:1347] Generated new cluster ID: 6bd6a31e1e534cedbf25fdfd5c5a60d3
I20260811 01:31:22.871563 29554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:22.884409 29554 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:22.885936 29554 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:22.895069 29554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9635f211cc245859e62715273d6b50e: Generated new TSK 0
I20260811 01:31:22.896075 29554 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:31:22.942902 29575 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 01:31:22.943228 29575 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:31:22.944430 29545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:22.920766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45888 (local address 127.23.39.254:42973)
0811 01:31:22.921001 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:22.921009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:22.921608 (+ 599us) server_negotiation.cc:407] Connection header received
0811 01:31:22.921979 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:22.921985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:22.922086 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:22.922294 (+ 208us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:31:22.922875 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.924084 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.925576 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.926312 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.926443 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:22.927005 (+ 562us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:31:22.943680 (+ 16675us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:31:22.944108 (+ 428us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45888: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 01:31:22.944584 29545 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45888: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 01:31:22.946417 29574 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:22.920644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42973 (local address 127.0.0.1:45888)
0811 01:31:22.921478 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:22.921497 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:22.921661 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:22.922334 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:22.922337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:22.922348 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:31:22.922693 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:22.922701 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.924257 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.924261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:22.925417 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:22.925430 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:22.926476 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:22.926481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:22.926615 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:22.926680 (+ 65us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:31:22.944093 (+ 17413us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 01:31:22.944412 (+ 319us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.39.254:42973: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":448,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.23.39.254:42973: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34245/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 01:31:22.948925 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29470
I20260811 01:31:22.950376 29534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:23.048157 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29470
2026-08-11T01:31:23Z chronyd exiting
I20260811 01:31:23.101559 23711 test_util.cc:175] -----------------------------------------------
I20260811 01:31:23.101701 23711 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786411836859029-23711-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (778 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 01:31:23.105652 23711 mini_oidc.cc:152] Starting JWKS server
I20260811 01:31:23.107617 23711 webserver.cc:460] Webserver started at https://127.0.0.1:37971/ using document root <none> and password file <none>
I20260811 01:31:23.107875 23711 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:31:23.108548 23711 webserver.cc:460] Webserver started at http://127.0.0.1:40241/ using document root <none> and password file <none>
2026-08-11T01:31:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:23Z Disabled control of system clock
I20260811 01:31:23.146004 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43207
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:43207
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37971/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/testchainca.cert with env {}
W20260811 01:31:23.493158 29583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:23.493533 29583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:23.493703 29583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:23.501264 29583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:23.501442 29583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:23.501539 29583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:23.501659 29583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:23.501747 29583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:31:23.501839 29583 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:31:23.501921 29583 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37971/jwks.json
I20260811 01:31:23.512871 29583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:43207
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37971/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:23.514423 29583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:23.515813 29583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:23.528275 29591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:23.528324 29589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:23.528478 29588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:23.529567 29583 server_base.cc:1034] running on GCE node
I20260811 01:31:23.530501 29583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:23.532071 29583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:23.533324 29583 hybrid_clock.cc:648] HybridClock initialized: now 1786411883533287 us; error 44 us; skew 500 ppm
I20260811 01:31:23.533692 29583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:23.536137 29583 webserver.cc:460] Webserver started at http://127.23.39.254:33093/ using document root <none> and password file <none>
I20260811 01:31:23.536887 29583 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:23.537032 29583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:23.537388 29583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:23.540525 29583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "6f0b5f49b86f4995950838e7a33bda58"
format_stamp: "Formatted at 2026-08-11 01:31:23 on dist-test-slave-9jjr"
server_key: "65e27f02ec4bde77ab7d58de6adf6f88"
server_key_iv: "cca1fe3ff9dd73b8daeb0955359e045f"
server_key_version: "encryptionkey@0"
I20260811 01:31:23.541381 29583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "6f0b5f49b86f4995950838e7a33bda58"
format_stamp: "Formatted at 2026-08-11 01:31:23 on dist-test-slave-9jjr"
server_key: "65e27f02ec4bde77ab7d58de6adf6f88"
server_key_iv: "cca1fe3ff9dd73b8daeb0955359e045f"
server_key_version: "encryptionkey@0"
I20260811 01:31:23.547026 29583 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:31:23.550756 29599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:23.552289 29583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:31:23.552507 29583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "6f0b5f49b86f4995950838e7a33bda58"
format_stamp: "Formatted at 2026-08-11 01:31:23 on dist-test-slave-9jjr"
server_key: "65e27f02ec4bde77ab7d58de6adf6f88"
server_key_iv: "cca1fe3ff9dd73b8daeb0955359e045f"
server_key_version: "encryptionkey@0"
I20260811 01:31:23.552759 29583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:23.570905 29583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:23.571875 29583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:23.572233 29583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:23.591980 29583 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:43207
I20260811 01:31:23.592001 29656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:43207 every 8 connection(s)
I20260811 01:31:23.593482 29583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:23.597348 29657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:23.601790 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29583
I20260811 01:31:23.602005 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:23.602938 23711 external_mini_cluster.cc:1428] Setting key 4fc85528c661f45d815772f440f545a2
I20260811 01:31:23.609539 29657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58: Bootstrap starting.
I20260811 01:31:23.613385 29657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:23.614831 29657 log.cc:824] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:23.617883 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:23.604970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55040 (local address 127.23.39.254:43207)
0811 01:31:23.606049 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:23.606063 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:23.606109 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:31:23.607998 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:23.608023 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:23.608500 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:23.608849 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:23.609467 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.610960 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.612899 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.613774 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.613932 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:23.615202 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:23.615209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:23.615223 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:23.616054 (+ 831us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:23.616158 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:23.616188 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:23.616330 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:23.616557 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 01:31:23.616937 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":423,"threads_started":1}
I20260811 01:31:23.618214 29657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58: No bootstrap required, opened a new log
I20260811 01:31:23.621999 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:31:23.626768 29657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } }
I20260811 01:31:23.627161 29657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:23.627326 29657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0b5f49b86f4995950838e7a33bda58, State: Initialized, Role: FOLLOWER
I20260811 01:31:23.627990 29657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } }
I20260811 01:31:23.628309 29657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:23.628495 29657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:23.628693 29657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:23.631084 29657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } }
I20260811 01:31:23.631654 29657 leader_election.cc:302] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f0b5f49b86f4995950838e7a33bda58; no voters:
I20260811 01:31:23.632287 29657 leader_election.cc:288] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:23.632462 29662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:23.633285 29662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [term 1 LEADER]: Becoming Leader. State: Replica: 6f0b5f49b86f4995950838e7a33bda58, State: Running, Role: LEADER
I20260811 01:31:23.633852 29662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } }
I20260811 01:31:23.634649 29657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:23.636770 29663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f0b5f49b86f4995950838e7a33bda58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } } }
I20260811 01:31:23.637264 29663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:23.636910 29664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f0b5f49b86f4995950838e7a33bda58. Latest consensus state: current_term: 1 leader_uuid: "6f0b5f49b86f4995950838e7a33bda58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0b5f49b86f4995950838e7a33bda58" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43207 } } }
I20260811 01:31:23.637766 29664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:23.644089 29668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:23.649852 29668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:23.660416 29668 catalog_manager.cc:1347] Generated new cluster ID: f1a937153f4741f5a8ab1a89aa9ba88a
I20260811 01:31:23.660597 29668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:23.680480 29668 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:23.681854 29668 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:23.688297 29668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f0b5f49b86f4995950838e7a33bda58: Generated new TSK 0
I20260811 01:31:23.689186 29668 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 01:31:23.722837 29690 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 01:31:23.722978 29690 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:31:23.724361 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:23.703291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55052 (local address 127.23.39.254:43207)
0811 01:31:23.703495 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:23.703501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:23.703896 (+ 395us) server_negotiation.cc:407] Connection header received
0811 01:31:23.704092 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:23.704098 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:23.704201 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:23.704377 (+ 176us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:31:23.704805 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.705988 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.707472 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.708173 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.708324 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:23.708866 (+ 542us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:31:23.723589 (+ 14723us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:31:23.724038 (+ 449us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55052: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 01:31:23.724402 29689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:23.703138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43207 (local address 127.0.0.1:55052)
0811 01:31:23.703785 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:23.703802 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:23.703924 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:23.704405 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:23.704408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:23.704418 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:31:23.704657 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:23.704663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.706211 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.706215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:23.707325 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:23.707337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:23.708402 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:23.708407 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:23.708555 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:23.708591 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:31:23.723859 (+ 15268us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 01:31:23.724089 (+ 230us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.39.254:43207: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":346,"threads_started":1}
W20260811 01:31:23.724512 29660 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55052: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37971/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 01:31:23.725178 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29583
I20260811 01:31:23.726522 29652 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:23.822742 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29583
2026-08-11T01:31:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (777 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 01:31:23.883841 23711 mini_oidc.cc:152] Starting JWKS server
I20260811 01:31:23.885864 23711 webserver.cc:460] Webserver started at https://127.0.0.1:44803/ using document root <none> and password file <none>
I20260811 01:31:23.886190 23711 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 01:31:23.886919 23711 webserver.cc:460] Webserver started at http://127.0.0.1:33047/ using document root <none> and password file <none>
2026-08-11T01:31:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:23Z Disabled control of system clock
I20260811 01:31:23.925627 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:46029
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:46029
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44803/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:31:24.268711 29697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:24.269081 29697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:24.269253 29697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:24.276587 29697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:24.276762 29697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:24.276865 29697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:24.276978 29697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:24.277066 29697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:31:24.277159 29697 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:31:24.277247 29697 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44803/jwks.json
I20260811 01:31:24.286765 29697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:46029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:46029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44803/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:24.288267 29697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:24.290166 29697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:24.302492 29706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:24.302940 29705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:24.302946 29708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:24.303519 29697 server_base.cc:1034] running on GCE node
I20260811 01:31:24.304340 29697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:24.305737 29697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:24.306986 29697 hybrid_clock.cc:648] HybridClock initialized: now 1786411884306945 us; error 50 us; skew 500 ppm
I20260811 01:31:24.307390 29697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:24.309746 29697 webserver.cc:460] Webserver started at http://127.23.39.254:42301/ using document root <none> and password file <none>
I20260811 01:31:24.310590 29697 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:24.310735 29697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:24.311084 29697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:24.314085 29697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "7031c9bb340a4edf9012efbdd47e8e12"
format_stamp: "Formatted at 2026-08-11 01:31:24 on dist-test-slave-9jjr"
server_key: "80c92bda7bd11855746cd33805a212e3"
server_key_iv: "6569cdcd545b0ed8a0103ef6f11541bc"
server_key_version: "encryptionkey@0"
I20260811 01:31:24.315132 29697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "7031c9bb340a4edf9012efbdd47e8e12"
format_stamp: "Formatted at 2026-08-11 01:31:24 on dist-test-slave-9jjr"
server_key: "80c92bda7bd11855746cd33805a212e3"
server_key_iv: "6569cdcd545b0ed8a0103ef6f11541bc"
server_key_version: "encryptionkey@0"
I20260811 01:31:24.320773 29697 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:24.324551 29714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:24.325917 29697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:24.326118 29697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "7031c9bb340a4edf9012efbdd47e8e12"
format_stamp: "Formatted at 2026-08-11 01:31:24 on dist-test-slave-9jjr"
server_key: "80c92bda7bd11855746cd33805a212e3"
server_key_iv: "6569cdcd545b0ed8a0103ef6f11541bc"
server_key_version: "encryptionkey@0"
I20260811 01:31:24.326416 29697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:24.348337 29697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:24.349290 29697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:24.349633 29697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:24.368981 29697 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:46029
I20260811 01:31:24.368999 29779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:46029 every 8 connection(s)
I20260811 01:31:24.370481 29697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:24.374456 29780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:24.380713 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29697
I20260811 01:31:24.380971 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:24.381788 23711 external_mini_cluster.cc:1428] Setting key aae301f051fb327f5e46f9122f8838c9
I20260811 01:31:24.386950 29780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12: Bootstrap starting.
I20260811 01:31:24.390316 29780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:24.391446 29780 log.cc:824] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:24.394764 29780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12: No bootstrap required, opened a new log
I20260811 01:31:24.397078 29783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:24.384304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.23.39.254:46029)
0811 01:31:24.385502 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:24.385516 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:24.385565 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:31:24.387566 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:24.387590 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:24.388150 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:24.388573 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:24.389168 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.390614 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.392146 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.392900 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.393127 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:24.394506 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:24.394514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:24.394530 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:24.395176 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:24.395281 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:24.395306 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:24.395458 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:24.395705 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 01:31:24.396048 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":412,"threads_started":1}
I20260811 01:31:24.401436 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:31:24.404037 29780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } }
I20260811 01:31:24.404558 29780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:24.404673 29780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7031c9bb340a4edf9012efbdd47e8e12, State: Initialized, Role: FOLLOWER
I20260811 01:31:24.405313 29780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } }
I20260811 01:31:24.405524 29780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:24.405620 29780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:24.405748 29780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:24.408342 29780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } }
I20260811 01:31:24.408970 29780 leader_election.cc:302] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7031c9bb340a4edf9012efbdd47e8e12; no voters:
I20260811 01:31:24.410252 29780 leader_election.cc:288] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:24.410393 29786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:24.411185 29786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [term 1 LEADER]: Becoming Leader. State: Replica: 7031c9bb340a4edf9012efbdd47e8e12, State: Running, Role: LEADER
I20260811 01:31:24.411764 29786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } }
I20260811 01:31:24.412487 29780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:24.415192 29787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7031c9bb340a4edf9012efbdd47e8e12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } } }
I20260811 01:31:24.415611 29787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:24.416522 29794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:24.416342 29788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7031c9bb340a4edf9012efbdd47e8e12. Latest consensus state: current_term: 1 leader_uuid: "7031c9bb340a4edf9012efbdd47e8e12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7031c9bb340a4edf9012efbdd47e8e12" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 46029 } } }
I20260811 01:31:24.416680 29788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:24.423321 29794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:24.435554 29794 catalog_manager.cc:1347] Generated new cluster ID: ed91ad12cfcd4733a23a49945ff40581
I20260811 01:31:24.435798 29794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:24.457547 29794 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:24.459607 29794 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:24.469528 29794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7031c9bb340a4edf9012efbdd47e8e12: Generated new TSK 0
I20260811 01:31:24.470750 29794 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:31:24.498704 29783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:24.489296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.23.39.254:46029)
0811 01:31:24.489567 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:24.489578 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:24.490091 (+ 513us) server_negotiation.cc:407] Connection header received
0811 01:31:24.490397 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:24.490401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:24.490481 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:24.490628 (+ 147us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:31:24.491291 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.492061 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.494300 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.494784 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.494891 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:24.495598 (+ 707us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:31:24.497953 (+ 2355us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:31:24.498375 (+ 422us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38098: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 01:31:24.499042 29783 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38098: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 01:31:24.499173 29813 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:24.489246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:46029 (local address 127.0.0.1:38098)
0811 01:31:24.489959 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:24.489981 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:24.490190 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:24.490688 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:24.490694 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:24.490708 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:31:24.491091 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:24.491108 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.492239 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.492245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:24.494073 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:24.494092 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:24.495018 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:24.495026 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:24.495244 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:24.495297 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:31:24.498235 (+ 2938us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 01:31:24.498515 (+ 280us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.39.254:46029: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44803/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":371,"threads_started":1}
I20260811 01:31:24.500768 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29697
I20260811 01:31:24.502048 29775 generic_service.cc:196] Checking for leaks (request via RPC)
E20260811 01:31:24.511348 29814 webserver.cc:533] Webserver: sslize failed:
E20260811 01:31:24.511504 29814 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 01:31:24.598080 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29697
2026-08-11T01:31:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (776 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T01:31:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:24Z Disabled control of system clock
I20260811 01:31:24.701144 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42861
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:39795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42861
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/testchainca.cert with env {}
W20260811 01:31:25.056432 29819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:25.056802 29819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:25.056900 29819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:25.064502 29819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:25.064633 29819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:25.064674 29819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:25.064726 29819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:25.064774 29819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 01:31:25.064831 29819 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 01:31:25.064874 29819 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 01:31:25.075101 29819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:39795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42861
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:25.076460 29819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:25.077780 29819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:25.090343 29824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:25.090304 29827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:25.090365 29825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:25.091213 29819 server_base.cc:1034] running on GCE node
I20260811 01:31:25.092108 29819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:25.093663 29819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:25.094913 29819 hybrid_clock.cc:648] HybridClock initialized: now 1786411885094867 us; error 60 us; skew 500 ppm
I20260811 01:31:25.095317 29819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:31:25.097800 29819 webserver.cc:460] Webserver started at http://127.23.39.254:34527/ using document root <none> and password file <none>
I20260811 01:31:25.098656 29819 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:25.098796 29819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:25.099120 29819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:25.102224 29819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "a285879b96df4c2d9d394bc5c503b6aa"
format_stamp: "Formatted at 2026-08-11 01:31:25 on dist-test-slave-9jjr"
server_key: "cf9f92d03b7f02eb9d0877fb34547c29"
server_key_iv: "edc6732b8c4130cde93f2d01a300041d"
server_key_version: "encryptionkey@0"
I20260811 01:31:25.103122 29819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "a285879b96df4c2d9d394bc5c503b6aa"
format_stamp: "Formatted at 2026-08-11 01:31:25 on dist-test-slave-9jjr"
server_key: "cf9f92d03b7f02eb9d0877fb34547c29"
server_key_iv: "edc6732b8c4130cde93f2d01a300041d"
server_key_version: "encryptionkey@0"
I20260811 01:31:25.108698 29819 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:25.112470 29834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:25.113919 29819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:25.114171 29819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "a285879b96df4c2d9d394bc5c503b6aa"
format_stamp: "Formatted at 2026-08-11 01:31:25 on dist-test-slave-9jjr"
server_key: "cf9f92d03b7f02eb9d0877fb34547c29"
server_key_iv: "edc6732b8c4130cde93f2d01a300041d"
server_key_version: "encryptionkey@0"
I20260811 01:31:25.114428 29819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:25.137427 29819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:25.138466 29819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:25.138782 29819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:25.158821 29819 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42861
I20260811 01:31:25.158844 29894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42861 every 8 connection(s)
I20260811 01:31:25.160346 29819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:25.161043 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29819
I20260811 01:31:25.161257 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:25.162110 23711 external_mini_cluster.cc:1428] Setting key e5b5b8fa115528c1b7225dd11e7e5603
I20260811 01:31:25.164968 29895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:25.176697 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:25.164187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54172 (local address 127.23.39.254:42861)
0811 01:31:25.165298 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:25.165310 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:25.165351 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:31:25.167062 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:25.167085 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:25.167546 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:25.167941 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:25.168577 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.169944 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.171905 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.172583 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.172717 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:25.174098 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:25.174105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:25.174119 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:31:25.174757 (+ 638us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:25.174858 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:31:25.174882 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:25.174986 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:25.175311 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 01:31:25.175685 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":380,"threads_started":1}
I20260811 01:31:25.177816 29895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa: Bootstrap starting.
I20260811 01:31:25.180801 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:31:25.181643 29895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:25.182737 29895 log.cc:824] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:25.185711 29895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa: No bootstrap required, opened a new log
I20260811 01:31:25.193598 29895 raft_consensus.cc:348] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } }
I20260811 01:31:25.194007 29895 raft_consensus.cc:374] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:25.194217 29895 raft_consensus.cc:729] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a285879b96df4c2d9d394bc5c503b6aa, State: Initialized, Role: FOLLOWER
I20260811 01:31:25.194809 29895 consensus_queue.cc:260] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } }
I20260811 01:31:25.195058 29895 raft_consensus.cc:388] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:25.195230 29895 raft_consensus.cc:482] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:25.195410 29895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:25.197863 29895 raft_consensus.cc:504] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } }
I20260811 01:31:25.198479 29895 leader_election.cc:302] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a285879b96df4c2d9d394bc5c503b6aa; no voters:
I20260811 01:31:25.199100 29895 leader_election.cc:288] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:25.199280 29900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:25.199992 29900 raft_consensus.cc:686] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [term 1 LEADER]: Becoming Leader. State: Replica: a285879b96df4c2d9d394bc5c503b6aa, State: Running, Role: LEADER
I20260811 01:31:25.200546 29900 consensus_queue.cc:237] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } }
I20260811 01:31:25.201319 29895 sys_catalog.cc:564] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:25.203948 29901 sys_catalog.cc:455] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a285879b96df4c2d9d394bc5c503b6aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } } }
I20260811 01:31:25.204137 29902 sys_catalog.cc:455] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader a285879b96df4c2d9d394bc5c503b6aa. Latest consensus state: current_term: 1 leader_uuid: "a285879b96df4c2d9d394bc5c503b6aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a285879b96df4c2d9d394bc5c503b6aa" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42861 } } }
I20260811 01:31:25.204542 29902 sys_catalog.cc:458] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:25.204430 29901 sys_catalog.cc:458] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:25.210911 29909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:25.216566 29909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:25.226645 29909 catalog_manager.cc:1347] Generated new cluster ID: d35b329a66fd4726bd05b489d5c21477
I20260811 01:31:25.226804 29909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:25.258630 29909 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:25.260025 29909 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:25.275255 29909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a285879b96df4c2d9d394bc5c503b6aa: Generated new TSK 0
I20260811 01:31:25.276314 29909 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:31:25.748415 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:25.302064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54178 (local address 127.23.39.254:42861)
0811 01:31:25.302312 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:25.302320 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:25.302780 (+ 460us) server_negotiation.cc:407] Connection header received
0811 01:31:25.303003 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:25.303010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:25.303129 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:25.303311 (+ 182us) server_negotiation.cc:226] Negotiated authn=JWT
0811 01:31:25.303717 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.304867 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.306318 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.307035 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.307163 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:25.307717 (+ 554us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 01:31:25.747598 (+439881us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:31:25.748088 (+ 490us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54178: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 01:31:25.748567 29898 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54178: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 01:31:25.748744 29926 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:25.301892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42861 (local address 127.0.0.1:54178)
0811 01:31:25.302673 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:25.302691 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:25.302820 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:25.303326 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:25.303329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:25.303339 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 01:31:25.303575 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:25.303581 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.305020 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.305024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:25.306099 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:25.306109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:25.307265 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:25.307270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:25.307401 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:25.307436 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 01:31:25.747962 (+440526us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 01:31:25.748306 (+ 344us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.39.254:42861: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":444,"threads_started":1}
I20260811 01:31:25.750168 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29819
I20260811 01:31:25.751389 29889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:25.859127 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29819
2026-08-11T01:31:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1241 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (438 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1712 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:28 dist-test-slave-9jjr krb5kdc[29946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:28 dist-test-slave-9jjr krb5kdc[29946](info): set up 2 sockets
Aug 11 01:31:28 dist-test-slave-9jjr krb5kdc[29946](info): commencing operation
krb5kdc: starting...
W20260811 01:31:29.192148 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:29 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:29.486404 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39427
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:29.839257 29961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:29.839676 29961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:29.839845 29961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:29.847711 29961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:29.847913 29961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:29.848043 29961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:29.848145 29961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:29.848238 29961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:29.858984 29961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:29.860520 29961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:29.862015 29961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:29.875232 29970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:29.875309 29968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:29.875306 29966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:29.876612 29961 server_base.cc:1034] running on GCE node
I20260811 01:31:29.877552 29961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:29.879181 29961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:29.880438 29961 hybrid_clock.cc:648] HybridClock initialized: now 1786411889880377 us; error 51 us; skew 500 ppm
I20260811 01:31:29.880867 29961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:29 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411889, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:29.884497 29961 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:29.886332 29961 webserver.cc:460] Webserver started at http://127.23.39.254:42101/ using document root <none> and password file <none>
I20260811 01:31:29.887080 29961 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:29.887233 29961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:29.887580 29961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:29.890810 29961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "002a0c659f3549eebde7c1c97e74f8eb"
format_stamp: "Formatted at 2026-08-11 01:31:29 on dist-test-slave-9jjr"
server_key: "a0888d99a3969b7256df807377ddc320"
server_key_iv: "d6c3f3aec7c4caa3e268e4a4700ce73b"
server_key_version: "encryptionkey@0"
I20260811 01:31:29.891638 29961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "002a0c659f3549eebde7c1c97e74f8eb"
format_stamp: "Formatted at 2026-08-11 01:31:29 on dist-test-slave-9jjr"
server_key: "a0888d99a3969b7256df807377ddc320"
server_key_iv: "d6c3f3aec7c4caa3e268e4a4700ce73b"
server_key_version: "encryptionkey@0"
I20260811 01:31:29.897284 29961 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:31:29.901254 29977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:29.902973 29961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 01:31:29.903193 29961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "002a0c659f3549eebde7c1c97e74f8eb"
format_stamp: "Formatted at 2026-08-11 01:31:29 on dist-test-slave-9jjr"
server_key: "a0888d99a3969b7256df807377ddc320"
server_key_iv: "d6c3f3aec7c4caa3e268e4a4700ce73b"
server_key_version: "encryptionkey@0"
I20260811 01:31:29.903431 29961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:29.928309 29961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:29.933725 29961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:29.934052 29961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:29.953509 29961 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39427
I20260811 01:31:29.953572 30039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39427 every 8 connection(s)
I20260811 01:31:29.955062 29961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:29.959146 30040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:29.964390 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 29961
I20260811 01:31:29.964619 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:29.965315 23711 external_mini_cluster.cc:1428] Setting key 8aa2a7b389bcb1587cf5aa595df7e90a
I20260811 01:31:29.971046 30040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb: Bootstrap starting.
I20260811 01:31:29.975219 30040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:29.976693 30040 log.cc:824] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:29.981066 30040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb: No bootstrap required, opened a new log
Aug 11 01:31:29 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:29.989899 30040 raft_consensus.cc:348] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } }
I20260811 01:31:29.990425 30040 raft_consensus.cc:374] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:29.990588 30040 raft_consensus.cc:729] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 002a0c659f3549eebde7c1c97e74f8eb, State: Initialized, Role: FOLLOWER
I20260811 01:31:29.991290 30040 consensus_queue.cc:260] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } }
I20260811 01:31:29.991597 30040 raft_consensus.cc:388] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:29.991765 30040 raft_consensus.cc:482] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:29.991958 30040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:29.992149 30045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:29.967596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43324 (local address 127.23.39.254:39427)
0811 01:31:29.968573 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:29.968589 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:29.968637 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:31:29.970517 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:29.970543 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:29.970965 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:29.971447 (+ 482us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:29.973399 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:29.974866 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:29.976874 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:29.978047 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:29.978337 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:29.983561 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:29.983572 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:29.983589 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:29.983651 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:29.987304 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:29.988161 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:29.988173 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:29.988181 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:29.988392 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:29.988831 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:29.988837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:29.988840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:29.989471 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:29.989800 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:29.990295 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 01:31:29.990822 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":448,"threads_started":1}
I20260811 01:31:29.994642 30040 raft_consensus.cc:504] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } }
I20260811 01:31:29.995266 30040 leader_election.cc:302] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 002a0c659f3549eebde7c1c97e74f8eb; no voters:
I20260811 01:31:29.995932 30040 leader_election.cc:288] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:29.996086 30048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:29.996845 30048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [term 1 LEADER]: Becoming Leader. State: Replica: 002a0c659f3549eebde7c1c97e74f8eb, State: Running, Role: LEADER
I20260811 01:31:29.997395 30048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } }
I20260811 01:31:29.998220 30040 sys_catalog.cc:564] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:30.000571 30050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 002a0c659f3549eebde7c1c97e74f8eb. Latest consensus state: current_term: 1 leader_uuid: "002a0c659f3549eebde7c1c97e74f8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } } }
I20260811 01:31:30.000561 30049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "002a0c659f3549eebde7c1c97e74f8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002a0c659f3549eebde7c1c97e74f8eb" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39427 } } }
I20260811 01:31:30.001024 30050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:30.001024 30049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:30.003760 30055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:30.009039 30055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:30.018303 30055 catalog_manager.cc:1347] Generated new cluster ID: 85054e2f69594f9ea3fa2b9bded4c9c8
I20260811 01:31:30.018500 30055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:30.035104 30055 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:30.036816 30055 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:30.049427 30055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 002a0c659f3549eebde7c1c97e74f8eb: Generated new TSK 0
I20260811 01:31:30.050451 30055 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:30.118184 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:30.477504 30069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:30.477877 30069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:30.478049 30069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:30.485625 30069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:30.485824 30069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:30.486008 30069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:30.497259 30069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:30.498854 30069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:30.500320 30069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:30.514541 30074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:30.514637 30075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:30.514565 30077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:30.515683 30069 server_base.cc:1034] running on GCE node
I20260811 01:31:30.516409 30069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:30.517472 30069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:30.518705 30069 hybrid_clock.cc:648] HybridClock initialized: now 1786411890518653 us; error 52 us; skew 500 ppm
I20260811 01:31:30.519050 30069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:30 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411890, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:30.522447 30069 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:30.524070 30069 webserver.cc:460] Webserver started at http://127.23.39.193:40965/ using document root <none> and password file <none>
I20260811 01:31:30.524752 30069 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:30.524868 30069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:30.525133 30069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:30.528290 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "4db61690c4e34f2f987356368ccc1993"
format_stamp: "Formatted at 2026-08-11 01:31:30 on dist-test-slave-9jjr"
server_key: "4760ee719acdacc00a6efdf9fec94881"
server_key_iv: "b859536bcac03564bf3903a75e8adba9"
server_key_version: "encryptionkey@0"
I20260811 01:31:30.529096 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "4db61690c4e34f2f987356368ccc1993"
format_stamp: "Formatted at 2026-08-11 01:31:30 on dist-test-slave-9jjr"
server_key: "4760ee719acdacc00a6efdf9fec94881"
server_key_iv: "b859536bcac03564bf3903a75e8adba9"
server_key_version: "encryptionkey@0"
I20260811 01:31:30.535068 30069 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:31:30.538923 30085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:30.540449 30069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:30.540643 30069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "4db61690c4e34f2f987356368ccc1993"
format_stamp: "Formatted at 2026-08-11 01:31:30 on dist-test-slave-9jjr"
server_key: "4760ee719acdacc00a6efdf9fec94881"
server_key_iv: "b859536bcac03564bf3903a75e8adba9"
server_key_version: "encryptionkey@0"
I20260811 01:31:30.540861 30069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:30.571985 30069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:30.576730 30069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:30.577065 30069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:30.578212 30069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:30.579674 30069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:30.579752 30069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:30.579932 30069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:30.580009 30069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:30.616793 30069 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:41635
I20260811 01:31:30.616834 30210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:41635 every 8 connection(s)
I20260811 01:31:30.618286 30069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:30.628130 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30069
I20260811 01:31:30.628372 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:30.629205 23711 external_mini_cluster.cc:1428] Setting key 6d4ac45bb0e786ea2044d7d3d4e362ab
Aug 11 01:31:30 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411890, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:30.641252 30214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:30.621001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54405 (local address 127.23.39.254:39427)
0811 01:31:30.621488 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:30.621495 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:30.622631 (+ 1136us) server_negotiation.cc:407] Connection header received
0811 01:31:30.624467 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:30.624473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:30.624548 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:30.624659 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:30.626264 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:30.626998 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:30.629331 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:30.629925 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:30.630068 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:30.634633 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:30.634640 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:30.634643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:30.634683 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:30.637669 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:30.638688 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:30.638693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:30.638695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:30.638832 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:30.639339 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:30.639343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:30.639346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:30.639637 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:30.639801 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:30.640589 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 01:31:30.640853 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":228,"threads_started":1}
I20260811 01:31:30.642371 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:30.621622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39427 (local address 127.23.39.193:54405)
0811 01:31:30.622448 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:30.622489 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:30.624196 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:30.624898 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:30.624905 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:30.625451 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:30.626039 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:30.626057 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:30.627147 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:30.627150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:30.629129 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:30.629146 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:30.630246 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:30.630254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:30.630584 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:30.631377 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:30.631404 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:30.634334 (+ 2930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:30.637877 (+ 3543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:30.637889 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:30.637911 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:30.638518 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:30.638956 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:30.638962 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:30.638966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:30.639199 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:30.639775 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:30.639783 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:30.640176 (+ 393us) client_negotiation.cc:769] Sending connection context
0811 01:31:30.640458 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 01:31:30.641071 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":305,"threads_started":1}
I20260811 01:31:30.644208 30211 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39427
I20260811 01:31:30.644551 30211 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:30.645455 30211 heartbeater.cc:511] Master 127.23.39.254:39427 requested a full tablet report, sending...
I20260811 01:31:30.647927 29996 ts_manager.cc:194] Registered new tserver with Master: 4db61690c4e34f2f987356368ccc1993 (127.23.39.193:41635)
I20260811 01:31:30.649590 29996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:54405
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:30.694815 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:31.053560 30218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:31.053910 30218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:31.054066 30218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:31.061841 30218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:31.061971 30218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:31.062202 30218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:31.072523 30218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:31.073920 30218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:31.075292 30218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:31.089051 30226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:31.089188 30224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:31.089504 30223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:31.089959 30218 server_base.cc:1034] running on GCE node
I20260811 01:31:31.090667 30218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:31.091717 30218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:31.092985 30218 hybrid_clock.cc:648] HybridClock initialized: now 1786411891092905 us; error 71 us; skew 500 ppm
I20260811 01:31:31.093369 30218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.096774 30218 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:31.098649 30218 webserver.cc:460] Webserver started at http://127.23.39.194:45133/ using document root <none> and password file <none>
I20260811 01:31:31.099448 30218 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:31.099601 30218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:31.099928 30218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:31.103197 30218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "dc5cbb04dffb4de4aa1b617be83305c6"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "f7c36438ccb20dd3d5df3030f3d167b3"
server_key_iv: "fd5a6e737b39cbbdb9418c293b6c787d"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.104112 30218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "dc5cbb04dffb4de4aa1b617be83305c6"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "f7c36438ccb20dd3d5df3030f3d167b3"
server_key_iv: "fd5a6e737b39cbbdb9418c293b6c787d"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.110003 30218 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:31:31.113860 30233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.115419 30218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:31:31.115628 30218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "dc5cbb04dffb4de4aa1b617be83305c6"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "f7c36438ccb20dd3d5df3030f3d167b3"
server_key_iv: "fd5a6e737b39cbbdb9418c293b6c787d"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.115882 30218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:31.129283 30218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:31.134173 30218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:31.134523 30218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:31.135588 30218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:31.137069 30218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:31.137179 30218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.137341 30218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:31.137418 30218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.174232 30218 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35751
I20260811 01:31:31.174337 30366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35751 every 8 connection(s)
I20260811 01:31:31.175706 30218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:31.184289 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30218
I20260811 01:31:31.184499 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:31.184983 23711 external_mini_cluster.cc:1428] Setting key dde94e12e69827f9fff51a1ad9fb4d99
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:31.200181 30369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.178501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:34693 (local address 127.23.39.254:39427)
0811 01:31:31.178990 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.178995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.180114 (+ 1119us) server_negotiation.cc:407] Connection header received
0811 01:31:31.182161 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.182168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.182275 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.182404 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.184190 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.185102 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.187080 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.187716 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.187864 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.192676 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.192682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.192686 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.192722 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.195674 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.196828 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.196834 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.196836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.197004 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.197663 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.197672 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.197677 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.198216 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.198429 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.199264 (+ 835us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.199578 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":235,"threads_started":1}
I20260811 01:31:31.201095 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.179125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39427 (local address 127.23.39.194:34693)
0811 01:31:31.179921 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:31.179963 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:31.181805 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:31.182735 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:31.182744 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:31.183365 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:31.183974 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:31.183992 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.185294 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.185299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:31.186912 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:31.186931 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.187964 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.187969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:31.188238 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.189041 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:31.189080 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:31.192367 (+ 3287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:31.195868 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:31.195883 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:31.195908 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:31.196654 (+ 746us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:31.197147 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:31.197154 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:31.197160 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:31.197459 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:31.198392 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:31.198400 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:31.198835 (+ 435us) client_negotiation.cc:769] Sending connection context
0811 01:31:31.199114 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:31:31.199761 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":317,"threads_started":1}
I20260811 01:31:31.202845 30367 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39427
I20260811 01:31:31.203281 30367 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:31.204330 30367 heartbeater.cc:511] Master 127.23.39.254:39427 requested a full tablet report, sending...
I20260811 01:31:31.206454 29996 ts_manager.cc:194] Registered new tserver with Master: dc5cbb04dffb4de4aa1b617be83305c6 (127.23.39.194:35751)
I20260811 01:31:31.207952 29996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:34693
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:31.250866 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:44621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:31.605800 30373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:31.606195 30373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:31.606390 30373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:31.614481 30373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:31.614660 30373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:31.614845 30373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:31.625838 30373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:44621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39427
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:31.627420 30373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:31.628913 30373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:31.644232 30382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:31.644295 30381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:31.644264 30385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:31.645605 30373 server_base.cc:1034] running on GCE node
I20260811 01:31:31.646499 30373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:31.647778 30373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:31.649046 30373 hybrid_clock.cc:648] HybridClock initialized: now 1786411891648966 us; error 64 us; skew 500 ppm
I20260811 01:31:31.649458 30373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.653298 30211 heartbeater.cc:503] Master 127.23.39.254:39427 was elected leader, sending a full tablet report...
I20260811 01:31:31.653707 30373 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:31.656049 30373 webserver.cc:460] Webserver started at http://127.23.39.195:36201/ using document root <none> and password file <none>
I20260811 01:31:31.656988 30373 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:31.657151 30373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:31.657631 30373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:31.661283 30373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "6fa1d216dbeb4c4faa71f99a4e03e921"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "448dbaa17d37cfc783a90005e3390087"
server_key_iv: "780623aa3ffee33ae5c2da9e32436ace"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.662413 30373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "6fa1d216dbeb4c4faa71f99a4e03e921"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "448dbaa17d37cfc783a90005e3390087"
server_key_iv: "780623aa3ffee33ae5c2da9e32436ace"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.668737 30373 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260811 01:31:31.673156 30393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.674793 30373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:31.675022 30373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "6fa1d216dbeb4c4faa71f99a4e03e921"
format_stamp: "Formatted at 2026-08-11 01:31:31 on dist-test-slave-9jjr"
server_key: "448dbaa17d37cfc783a90005e3390087"
server_key_iv: "780623aa3ffee33ae5c2da9e32436ace"
server_key_version: "encryptionkey@0"
I20260811 01:31:31.675336 30373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:31.695189 30373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:31.700376 30373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:31.700768 30373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:31.701896 30373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:31.703619 30373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:31.703744 30373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.703926 30373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:31.703977 30373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:31.741616 30373 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:44865
I20260811 01:31:31.741672 30527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:44865 every 8 connection(s)
I20260811 01:31:31.743171 30373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:31.749785 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30373
I20260811 01:31:31.750006 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:31.750684 23711 external_mini_cluster.cc:1428] Setting key 6ea7908b571de5eda9832a2fc9132aad
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:31.767004 30530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.746315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:57529 (local address 127.23.39.254:39427)
0811 01:31:31.746841 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.746846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.748041 (+ 1195us) server_negotiation.cc:407] Connection header received
0811 01:31:31.750284 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.750292 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.750393 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.750531 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.752609 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.753783 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.755619 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.756036 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.756139 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.760018 (+ 3879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.760024 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.760027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.760067 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.763004 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.764012 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.764017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.764020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.764174 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.764712 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.764717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.764719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.765077 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.765264 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.766346 (+ 1082us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.766645 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":276,"threads_started":1}
I20260811 01:31:31.768136 30531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.746836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39427 (local address 127.23.39.195:57529)
0811 01:31:31.747819 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:31.747888 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:31.749834 (+ 1946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:31.750803 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:31.750843 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:31.751666 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:31.752414 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:31.752441 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.753993 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.753999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:31.755455 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:31.755470 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.756255 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.756259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:31.756471 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.757225 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:31.757252 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:31.759737 (+ 2485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:31.763260 (+ 3523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:31.763269 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:31.763285 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:31.763833 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:31.764294 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:31.764298 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:31.764300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:31.764519 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:31.765234 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:31.765242 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:31.765795 (+ 553us) client_negotiation.cc:769] Sending connection context
0811 01:31:31.766099 (+ 304us) client_negotiation.cc:240] Negotiation successful
0811 01:31:31.766792 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":417,"threads_started":1}
I20260811 01:31:31.769994 30528 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39427
I20260811 01:31:31.770517 30528 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:31.771449 30528 heartbeater.cc:511] Master 127.23.39.254:39427 requested a full tablet report, sending...
I20260811 01:31:31.773352 29996 ts_manager.cc:194] Registered new tserver with Master: 6fa1d216dbeb4c4faa71f99a4e03e921 (127.23.39.195:44865)
I20260811 01:31:31.774389 29996 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:57529
I20260811 01:31:31.780483 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/test-admin.keytab.
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.817428 23711 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 01:31:31.823489 30538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:31.820476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51582 (local address 127.23.39.193:41635)
0811 01:31:31.821291 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.821299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.821328 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:31:31.821392 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.821399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.821623 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.821776 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.822960 (+ 1184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51582: BlockingRecv error: recv got EOF from 127.0.0.1:51582 (error 108)
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":458,"threads_started":1}
W20260811 01:31:31.823645 23711 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.825438 23711 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.827041 23711 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:31.844424 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.829075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.23.39.193:41635)
0811 01:31:31.829366 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.829371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.829528 (+ 157us) server_negotiation.cc:407] Connection header received
0811 01:31:31.829705 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.829709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.829773 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.829863 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.831079 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.832103 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.833573 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.834274 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.834383 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.838537 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.838554 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.838569 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.838620 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.841492 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.842312 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.842320 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.842322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.842462 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.842853 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.842856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.842858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.843264 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.843507 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.843814 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.844082 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
W20260811 01:31:31.851087 30538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:31.848904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51592 (local address 127.23.39.193:41635)
0811 01:31:31.849146 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.849152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.849470 (+ 318us) server_negotiation.cc:407] Connection header received
0811 01:31:31.849668 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.849673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.849749 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.849858 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.850785 (+ 927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51592: BlockingRecv error: recv got EOF from 127.0.0.1:51592 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 01:31:31.851301 23711 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.853037 23711 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.854802 23711 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:31.871451 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.856602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51596 (local address 127.23.39.193:41635)
0811 01:31:31.856863 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.856871 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.857208 (+ 337us) server_negotiation.cc:407] Connection header received
0811 01:31:31.857401 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.857406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.857476 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.857597 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.858733 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.859506 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.860856 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.861336 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.861487 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.865690 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.865695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.865699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.865750 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.868498 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.869356 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.869361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.869363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.869506 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.869893 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.869896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.869898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.870301 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.870517 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.870916 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.871150 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 01:31:31.876705 30538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:31.874670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.23.39.193:41635)
0811 01:31:31.874876 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.874884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.875233 (+ 349us) server_negotiation.cc:407] Connection header received
0811 01:31:31.875441 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.875445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.875518 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.875625 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.876448 (+ 823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51604: BlockingRecv error: recv got EOF from 127.0.0.1:51604 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 01:31:31.876931 23711 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786411836859029-23711-0/krb5kdc/krb5cc' of type FILE
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.878734 23711 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:31.880192 23711 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 01:31:31 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:31.896188 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.881695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51620 (local address 127.23.39.193:41635)
0811 01:31:31.881953 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.881959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.882279 (+ 320us) server_negotiation.cc:407] Connection header received
0811 01:31:31.882481 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.882485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.882548 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.882662 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.883668 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.884577 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.885837 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.886381 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.886523 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.890474 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.890480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.890483 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.890524 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.893181 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.893980 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.893985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.893991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.894217 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.894636 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.894641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.894645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.894948 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.895323 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.895601 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.895844 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 01:31:31.898083 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30069
I20260811 01:31:31.911183 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:31.899170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51622 (local address 127.23.39.193:41635)
0811 01:31:31.899440 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:31.899445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:31.899531 (+ 86us) server_negotiation.cc:407] Connection header received
0811 01:31:31.899740 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:31.899743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:31.899805 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:31.899887 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:31.900926 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.901599 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.902879 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:31.903369 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:31.903465 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:31.905713 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:31.905717 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:31.905721 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:31.905754 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:31.908373 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.909112 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.909118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.909122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.909289 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:31.909662 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:31.909667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:31.909670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:31.909948 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:31.910290 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:31.910606 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 01:31:31.910835 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260811 01:31:31.911927 30206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:31.998660 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30069
I20260811 01:31:32.020839 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30218
Aug 11 01:31:32 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:32.038484 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:32.021955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57454 (local address 127.23.39.194:35751)
0811 01:31:32.022584 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:32.022592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:32.022635 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:31:32.022698 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:32.022704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:32.022924 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:32.023120 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:32.024330 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:32.025384 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:32.026848 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:32.027473 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:32.027667 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:32.031940 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:32.031955 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:32.031971 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:32.032012 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:32.035263 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:32.036103 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:32.036111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:32.036114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:32.036251 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:32.036698 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:32.036704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:32.036714 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:32.037105 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:32.037470 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:32.037826 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 01:31:32.038150 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":347,"threads_started":1}
I20260811 01:31:32.039898 30362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:32.126875 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30218
I20260811 01:31:32.148468 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30373
Aug 11 01:31:32 dist-test-slave-9jjr krb5kdc[29946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:32.165704 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:32.149505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.23.39.195:44865)
0811 01:31:32.150258 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:32.150265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:32.150297 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:31:32.150365 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:32.150372 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:32.150590 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:32.150727 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:32.151780 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:32.153534 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:32.155080 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:32.155683 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:32.155795 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:32.159944 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:32.159958 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:32.159974 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:32.160014 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:32.163022 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:32.163757 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:32.163764 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:32.163768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:32.163895 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:32.164230 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:32.164234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:32.164236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:32.164592 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:32.164837 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:32.165082 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 01:31:32.165364 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":368,"threads_started":1}
I20260811 01:31:32.167156 30522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:32.253407 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30373
I20260811 01:31:32.276221 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 29961
I20260811 01:31:32.277474 30033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:32.386027 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 29961
2026-08-11T01:31:32Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4378 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:32 dist-test-slave-9jjr krb5kdc[30559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:32 dist-test-slave-9jjr krb5kdc[30559](info): set up 2 sockets
Aug 11 01:31:32 dist-test-slave-9jjr krb5kdc[30559](info): commencing operation
krb5kdc: starting...
W20260811 01:31:33.573567 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:33 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:33Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab.
Entry for principal oryx/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab.
I20260811 01:31:33.871440 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36077
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab
--principal=oryx/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36077
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:34.229813 30573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:34.230185 30573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:34.230286 30573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:34.237787 30573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:34.237938 30573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:34.237986 30573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:34.238046 30573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:34.238098 30573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:34.248765 30573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab
--principal=oryx/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:34.250247 30573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:34.251601 30573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:34.264390 30579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:34.264500 30578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:34.265008 30582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:34.265389 30573 server_base.cc:1034] running on GCE node
I20260811 01:31:34.266391 30573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:34.267930 30573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:34.269143 30573 hybrid_clock.cc:648] HybridClock initialized: now 1786411894269114 us; error 45 us; skew 500 ppm
I20260811 01:31:34.269469 30573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:34 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411894, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:34.277318 30573 init.cc:377] Logged in from keytab as oryx/127.23.39.254@KRBTEST.COM (short username oryx)
I20260811 01:31:34.279162 30573 webserver.cc:460] Webserver started at http://127.23.39.254:33913/ using document root <none> and password file <none>
I20260811 01:31:34.280100 30573 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:34.280236 30573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:34.280512 30573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:34.283996 30573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "e16e9c9d22ac47bea3828f9451b5cfc0"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "4086a257a21e592625912fd0859efeb8"
server_key_iv: "b4a0bc6e8108b233257871d25c473736"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.284862 30573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "e16e9c9d22ac47bea3828f9451b5cfc0"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "4086a257a21e592625912fd0859efeb8"
server_key_iv: "b4a0bc6e8108b233257871d25c473736"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.291644 30573 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:31:34.295815 30589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:34.297544 30573 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:31:34.297726 30573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "e16e9c9d22ac47bea3828f9451b5cfc0"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "4086a257a21e592625912fd0859efeb8"
server_key_iv: "b4a0bc6e8108b233257871d25c473736"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.297924 30573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:34.312497 30573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:34.317190 30573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:34.317559 30573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:34.337711 30573 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:36077
I20260811 01:31:34.337757 30648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:36077 every 8 connection(s)
I20260811 01:31:34.339334 30573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:34.340890 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30573
I20260811 01:31:34.341149 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:34.342075 23711 external_mini_cluster.cc:1428] Setting key 6aac887d8834730c0fbb05faafb4d492
I20260811 01:31:34.344708 30649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:31:34 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:34.360509 30649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Bootstrap starting.
I20260811 01:31:34.364497 30649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:34.365792 30649 log.cc:824] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:34.368085 30652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:34.344366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54446 (local address 127.23.39.254:36077)
0811 01:31:34.345205 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:34.345218 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:34.345257 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:31:34.346995 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:34.347018 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:34.347410 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:34.347759 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:34.349894 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:34.351406 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:34.353398 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:34.354101 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:34.354313 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:34.359614 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:34.359631 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:34.359655 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:34.359716 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:34.363304 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:34.364373 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:34.364380 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:34.364387 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:34.364570 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:34.365028 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:34.365040 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:34.365042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:34.365648 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:34.365987 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:34.366555 (+ 568us) server_negotiation.cc:299] Negotiation successful
0811 01:31:34.367024 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":387,"threads_started":1}
I20260811 01:31:34.369349 30649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: No bootstrap required, opened a new log
I20260811 01:31:34.378238 30649 raft_consensus.cc:348] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } }
I20260811 01:31:34.378705 30649 raft_consensus.cc:374] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:34.378839 30649 raft_consensus.cc:729] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16e9c9d22ac47bea3828f9451b5cfc0, State: Initialized, Role: FOLLOWER
I20260811 01:31:34.379449 30649 consensus_queue.cc:260] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } }
I20260811 01:31:34.379736 30649 raft_consensus.cc:388] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:34.379913 30649 raft_consensus.cc:482] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:34.380110 30649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:34.382823 30649 raft_consensus.cc:504] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } }
I20260811 01:31:34.383397 30649 leader_election.cc:302] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e16e9c9d22ac47bea3828f9451b5cfc0; no voters:
I20260811 01:31:34.384058 30649 leader_election.cc:288] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:34.384220 30654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:34.385412 30654 raft_consensus.cc:686] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 LEADER]: Becoming Leader. State: Replica: e16e9c9d22ac47bea3828f9451b5cfc0, State: Running, Role: LEADER
I20260811 01:31:34.385915 30654 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } }
I20260811 01:31:34.386461 30649 sys_catalog.cc:564] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:34.389294 30656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16e9c9d22ac47bea3828f9451b5cfc0. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } }
I20260811 01:31:34.389258 30655 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } }
I20260811 01:31:34.389675 30656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:34.390045 30655 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:34.400468 30662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:34.406961 30662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:34.417632 30662 catalog_manager.cc:1347] Generated new cluster ID: 443b9196818c4da5a418f427eb274cd5
I20260811 01:31:34.417805 30662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:34.443442 30662 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:34.444859 30662 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:34.457927 30662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Generated new TSK 0
I20260811 01:31:34.458839 30662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
I20260811 01:31:34.540155 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:34.925832 30678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:34.926244 30678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:34.926359 30678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:34.934267 30678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:34.934446 30678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:34.934576 30678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:34.945243 30678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:34.946694 30678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:34.948019 30678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:34.961846 30685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:34.961907 30684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:34.961840 30688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:34.962878 30678 server_base.cc:1034] running on GCE node
I20260811 01:31:34.963594 30678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:34.964609 30678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:34.965857 30678 hybrid_clock.cc:648] HybridClock initialized: now 1786411894965805 us; error 45 us; skew 500 ppm
I20260811 01:31:34.966288 30678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:34 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411894, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:34.969837 30678 init.cc:377] Logged in from keytab as oryx/127.23.39.193@KRBTEST.COM (short username oryx)
I20260811 01:31:34.971632 30678 webserver.cc:460] Webserver started at http://127.23.39.193:36663/ using document root <none> and password file <none>
I20260811 01:31:34.972353 30678 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:34.972466 30678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:34.972745 30678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:34.976022 30678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "86163ec230ce4d78b4020696079083d2"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "24d9a8d00ae1d611f0e99ab4e266736b"
server_key_iv: "d38e97df6603989af9fc81aa20cd7968"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.976867 30678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "86163ec230ce4d78b4020696079083d2"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "24d9a8d00ae1d611f0e99ab4e266736b"
server_key_iv: "d38e97df6603989af9fc81aa20cd7968"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.982772 30678 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:31:34.986598 30698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:34.988179 30678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:31:34.988389 30678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "86163ec230ce4d78b4020696079083d2"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "24d9a8d00ae1d611f0e99ab4e266736b"
server_key_iv: "d38e97df6603989af9fc81aa20cd7968"
server_key_version: "encryptionkey@0"
I20260811 01:31:34.988607 30678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:35.008219 30678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:35.013370 30678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:35.013715 30678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:35.014983 30678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:35.016528 30678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:35.016603 30678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:35.016737 30678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:35.016806 30678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:35.053056 30678 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33643
I20260811 01:31:35.053093 30828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33643 every 8 connection(s)
I20260811 01:31:35.054491 30678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:35.061146 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30678
I20260811 01:31:35.061408 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:35.062075 23711 external_mini_cluster.cc:1428] Setting key 0ef382fa20cbfc3bdac3b09ec84c5941
Aug 11 01:31:35 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411894, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:35.078639 30832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:35.057343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54559 (local address 127.23.39.254:36077)
0811 01:31:35.057788 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:35.057793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:35.058936 (+ 1143us) server_negotiation.cc:407] Connection header received
0811 01:31:35.060940 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:35.060947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:35.061046 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:35.061167 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:35.063026 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.063888 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.065634 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.066450 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.066612 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:35.070408 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:35.070418 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:35.070425 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:35.070476 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:35.074729 (+ 4253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:35.075896 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:35.075901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:35.075904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:35.076045 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:35.076636 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:35.076639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:35.076642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:35.076933 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:35.077048 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:35.078051 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0811 01:31:35.078338 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":220,"threads_started":1}
I20260811 01:31:35.080307 30833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:35.057944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:54559)
0811 01:31:35.058754 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:35.058808 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:35.060619 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:35.061431 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:35.061441 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:35.062040 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:35.062815 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:35.062844 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.064091 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.064097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:35.065443 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:35.065457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.066692 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.066698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:35.066938 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:35.067705 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:35.067735 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:35.070052 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:35.074934 (+ 4882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:35.074943 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:35.074959 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:35.075717 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:35.076168 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:35.076175 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:35.076179 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:35.076513 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:35.077070 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:35.077082 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:35.077611 (+ 529us) client_negotiation.cc:769] Sending connection context
0811 01:31:35.077953 (+ 342us) client_negotiation.cc:240] Negotiation successful
0811 01:31:35.078630 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":358,"threads_started":1}
I20260811 01:31:35.082226 30829 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:35.082582 30829 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:35.083438 30829 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:35.085731 30609 ts_manager.cc:194] Registered new tserver with Master: 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643)
I20260811 01:31:35.087528 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:54559
WARNING: no policy specified for oryx/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
I20260811 01:31:35.125589 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:35.484668 30836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:35.485014 30836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:35.485194 30836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:35.494266 30836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:35.494421 30836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:35.494606 30836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:35.505048 30836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:35.506618 30836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:35.508061 30836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:35.521950 30843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:35.522051 30847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:35.521863 30842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:35.523036 30836 server_base.cc:1034] running on GCE node
I20260811 01:31:35.523769 30836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:35.524809 30836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:35.526059 30836 hybrid_clock.cc:648] HybridClock initialized: now 1786411895526006 us; error 46 us; skew 500 ppm
I20260811 01:31:35.526459 30836 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:35 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411895, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:35.529917 30836 init.cc:377] Logged in from keytab as oryx/127.23.39.194@KRBTEST.COM (short username oryx)
I20260811 01:31:35.531668 30836 webserver.cc:460] Webserver started at http://127.23.39.194:38147/ using document root <none> and password file <none>
I20260811 01:31:35.532418 30836 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:35.532579 30836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:35.532903 30836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:35.536168 30836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "d503ef7ee3084b03b24d53b6795b1b4b"
format_stamp: "Formatted at 2026-08-11 01:31:35 on dist-test-slave-9jjr"
server_key: "fabea6ed4098577e427b93034e9314b9"
server_key_iv: "163e53dffc492e90c14669da87715f69"
server_key_version: "encryptionkey@0"
I20260811 01:31:35.537060 30836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "d503ef7ee3084b03b24d53b6795b1b4b"
format_stamp: "Formatted at 2026-08-11 01:31:35 on dist-test-slave-9jjr"
server_key: "fabea6ed4098577e427b93034e9314b9"
server_key_iv: "163e53dffc492e90c14669da87715f69"
server_key_version: "encryptionkey@0"
I20260811 01:31:35.542956 30836 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 01:31:35.547200 30854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:35.548826 30836 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:31:35.549031 30836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "d503ef7ee3084b03b24d53b6795b1b4b"
format_stamp: "Formatted at 2026-08-11 01:31:35 on dist-test-slave-9jjr"
server_key: "fabea6ed4098577e427b93034e9314b9"
server_key_iv: "163e53dffc492e90c14669da87715f69"
server_key_version: "encryptionkey@0"
I20260811 01:31:35.549268 30836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:35.576810 30836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:35.581899 30836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:35.582319 30836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:35.583488 30836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:35.585033 30836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:35.585151 30836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:35.585321 30836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:35.585399 30836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:35.621542 30836 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:34559
I20260811 01:31:35.621584 30985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:34559 every 8 connection(s)
I20260811 01:31:35.622947 30836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:35.624715 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30836
I20260811 01:31:35.624918 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:35.625546 23711 external_mini_cluster.cc:1428] Setting key d0948cc76ab27d546851b92964b93e93
Aug 11 01:31:35 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411895, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:35.645726 30988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:35.625833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:36721 (local address 127.23.39.254:36077)
0811 01:31:35.626352 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:35.626356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:35.627568 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 01:31:35.629495 (+ 1927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:35.629501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:35.629591 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:35.629721 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:35.631481 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.632236 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.633937 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.634486 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.634634 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:35.638815 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:35.638821 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:35.638824 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:35.638873 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:35.641924 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:35.643097 (+ 1173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:35.643102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:35.643104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:35.643247 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:35.643840 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:35.643843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:35.643845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:35.644130 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:35.644249 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:35.645240 (+ 991us) server_negotiation.cc:299] Negotiation successful
0811 01:31:35.645447 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":300,"threads_started":1}
I20260811 01:31:35.647619 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:35.626522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:36721)
0811 01:31:35.627372 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:35.627435 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:35.629194 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:35.629993 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:35.630001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:35.630637 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:35.631273 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:35.631293 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.632438 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.632442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:35.633748 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:35.633767 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:35.634765 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:35.634772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:35.635049 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:35.635835 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:35.635860 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:35.638477 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:35.642153 (+ 3676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:35.642167 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:35.642190 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:35.642940 (+ 750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:35.643392 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:35.643401 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:35.643407 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:35.643716 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:35.644274 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:35.644294 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:35.644822 (+ 528us) client_negotiation.cc:769] Sending connection context
0811 01:31:35.645158 (+ 336us) client_negotiation.cc:240] Negotiation successful
0811 01:31:35.645818 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":317,"threads_started":1}
I20260811 01:31:35.649375 30986 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:35.649720 30986 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:35.650580 30986 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:35.652341 30609 ts_manager.cc:194] Registered new tserver with Master: d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:35.653306 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:36721
WARNING: no policy specified for oryx/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
I20260811 01:31:35.689949 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:36.051724 30992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:36.052170 30992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:36.052366 30992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:36.061025 30992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:36.061255 30992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:36.061446 30992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:36.072849 30992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:36.074469 30992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:36.075899 30992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:31:36.091218 30829 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
W20260811 01:31:36.092041 31002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:36.091588 30998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:36.092053 31000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:36.095885 30992 server_base.cc:1034] running on GCE node
I20260811 01:31:36.096725 30992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:36.097927 30992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:36.099241 30992 hybrid_clock.cc:648] HybridClock initialized: now 1786411896099159 us; error 86 us; skew 500 ppm
I20260811 01:31:36.099643 30992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411896, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:36.103533 30992 init.cc:377] Logged in from keytab as oryx/127.23.39.195@KRBTEST.COM (short username oryx)
I20260811 01:31:36.105316 30992 webserver.cc:460] Webserver started at http://127.23.39.195:45395/ using document root <none> and password file <none>
I20260811 01:31:36.106204 30992 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:36.106343 30992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:36.106643 30992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:36.110021 30992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "a0e07fd71c214f51bc1a29509d50ccff"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "41c4561e30de956ee890296673059e5d"
server_key_iv: "adbb01afe7da5c24d920a109c8523427"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.111083 30992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "a0e07fd71c214f51bc1a29509d50ccff"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "41c4561e30de956ee890296673059e5d"
server_key_iv: "adbb01afe7da5c24d920a109c8523427"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.117136 30992 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:31:36.121011 31011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:36.122524 30992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:31:36.122723 30992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "a0e07fd71c214f51bc1a29509d50ccff"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "41c4561e30de956ee890296673059e5d"
server_key_iv: "adbb01afe7da5c24d920a109c8523427"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.122967 30992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:36.136662 30992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:36.141485 30992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:36.141816 30992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:36.143009 30992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:36.144487 30992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:36.144598 30992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:36.144761 30992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:36.144835 30992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:36.181592 30992 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:38721
I20260811 01:31:36.181627 31137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:38721 every 8 connection(s)
I20260811 01:31:36.183137 30992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:36.189893 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 30992
I20260811 01:31:36.190109 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:36.190750 23711 external_mini_cluster.cc:1428] Setting key 6bee7c341af4bf44c2ba034c592fb477
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411896, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:36.205557 31140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.185868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:54995 (local address 127.23.39.254:36077)
0811 01:31:36.186446 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.186452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.187498 (+ 1046us) server_negotiation.cc:407] Connection header received
0811 01:31:36.189371 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.189376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.189452 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.189554 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.191764 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.192890 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.194993 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.195407 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.195512 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.199137 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.199143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.199146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.199189 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.202069 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.202961 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.202965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.202968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.203148 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.203599 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.203602 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.203605 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.203892 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.204010 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.204790 (+ 780us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.205037 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":296,"threads_started":1}
I20260811 01:31:36.206820 31141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.186529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:54995)
0811 01:31:36.187335 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.187374 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.189087 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.189880 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.189892 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.190716 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.191552 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.191576 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.193146 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.193151 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.194839 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.194860 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.195623 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.195628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.195843 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.196546 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.196570 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.198912 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.202290 (+ 3378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.202298 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.202314 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.202840 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.203254 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.203258 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.203260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.203495 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.204001 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.204007 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.204361 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.204683 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.205272 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":285,"threads_started":1}
I20260811 01:31:36.208237 31138 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:36.208573 31138 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:36.209340 31138 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:36.210991 30609 ts_manager.cc:194] Registered new tserver with Master: a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:36.211822 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:54995
I20260811 01:31:36.220832 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.39.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.253.keytab.
Entry for principal oryx/127.23.39.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.253.keytab.
I20260811 01:31:36.286412 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:34987
--webserver_interface=127.23.39.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.253.keytab
--principal=oryx/127.23.39.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36077,127.23.39.253:34987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:36.644517 31144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:36.644860 31144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:36.644979 31144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:36.653573 31144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:36.653710 31144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:36.653801 31144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:36.653887 31144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:36.653936 31144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:36.656194 30986 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
I20260811 01:31:36.667735 31144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36077,127.23.39.253:34987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.253.keytab
--principal=oryx/127.23.39.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:34987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.39.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
W20260811 01:31:36.668111 31144 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.23.39.254:36077,127.23.39.253:34987'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 01:31:36.669160 31144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:36.670564 31144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:36.682717 31151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:36.682924 31150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:36.682713 31154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:36.683893 31144 server_base.cc:1034] running on GCE node
I20260811 01:31:36.684777 31144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:36.686414 31144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:36.687669 31144 hybrid_clock.cc:648] HybridClock initialized: now 1786411896687599 us; error 67 us; skew 500 ppm
I20260811 01:31:36.688014 31144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411896, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:36.691320 31144 init.cc:377] Logged in from keytab as oryx/127.23.39.253@KRBTEST.COM (short username oryx)
I20260811 01:31:36.693053 31144 webserver.cc:460] Webserver started at http://127.23.39.253:35119/ using document root <none> and password file <none>
I20260811 01:31:36.693902 31144 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:36.694044 31144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:36.694414 31144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:36.697641 31144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/instance:
uuid: "aa83e547dda042a6bd7eeb88e17e8606"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "f98cf063e93b0562ab02807de33a20f6"
server_key_iv: "947814af6468759df3400555e1386647"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.698555 31144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal/instance:
uuid: "aa83e547dda042a6bd7eeb88e17e8606"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "f98cf063e93b0562ab02807de33a20f6"
server_key_iv: "947814af6468759df3400555e1386647"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.704284 31144 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:31:36.708060 31164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:36.709522 31144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:36.709728 31144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "aa83e547dda042a6bd7eeb88e17e8606"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "f98cf063e93b0562ab02807de33a20f6"
server_key_iv: "947814af6468759df3400555e1386647"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.709977 31144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:36.730736 31144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:36.735519 31144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:36.735841 31144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:36.756143 31144 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.253:34987
I20260811 01:31:36.756155 31218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.253:34987 every 8 connection(s)
I20260811 01:31:36.757686 31144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
I20260811 01:31:36.761891 31219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:36.765564 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 31144
I20260811 01:31:36.770737 31219 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411896, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.253@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:36.790632 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.773583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40366 (local address 127.23.39.254:36077)
0811 01:31:36.774505 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.774511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.774837 (+ 326us) server_negotiation.cc:407] Connection header received
0811 01:31:36.775083 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.775087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.775171 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.775297 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.776924 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.778003 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.780043 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.780466 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.780571 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.784560 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.784565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.784569 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.784610 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.787440 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.788288 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.788294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.788302 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.788426 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.788890 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.788894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.788896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.789234 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.789404 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.789992 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.790266 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":695,"threads_started":1}
I20260811 01:31:36.791781 31225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.768207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45376 (local address 127.23.39.253:34987)
0811 01:31:36.769020 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.769033 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.769078 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:31:36.770988 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.771017 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.771481 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.771897 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.773602 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.775555 (+ 1953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.777358 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.778474 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.778621 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.783969 (+ 5348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.783979 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.783998 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.784033 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.787406 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.788274 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.788283 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.788287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.788461 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.788877 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.788885 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.788888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.789499 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.789840 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.790206 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.790717 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":177,"server-negotiator.queue_time_us":594,"thread_start_us":351,"threads_started":1}
I20260811 01:31:36.791824 31226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.773483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40366)
0811 01:31:36.774687 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.774733 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.774931 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.775368 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.775376 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.776360 (+ 984us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.776735 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.776749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.778197 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.778203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.779881 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.779897 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.780757 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.780766 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.781010 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.781765 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.781805 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.784333 (+ 2528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.787625 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.787640 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.787656 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.788150 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.788547 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.788552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.788556 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.788730 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.789377 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.789385 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.789605 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.789881 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.790501 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":401,"threads_started":1}
I20260811 01:31:36.794049 31219 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411896, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.253@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
I20260811 01:31:36.806862 31226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.795080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45378)
0811 01:31:36.795283 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.795303 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.795416 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.795663 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.795666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.796008 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.796152 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.796160 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.797092 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.797096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.797953 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.797963 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.798672 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.798676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.798895 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.799542 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.799560 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.801716 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.804741 (+ 3025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.804745 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.804747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.805132 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.805445 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.805448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.805450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.805578 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.806040 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.806044 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.806238 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.806356 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.806574 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 01:31:36.806982 31225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.795303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.23.39.253:34987)
0811 01:31:36.795423 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.795427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.795442 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:31:36.795501 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.795504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.795555 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.795629 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.796276 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.796972 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.798070 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.798543 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.798642 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.801897 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.801902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.801905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.801933 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.804615 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.805227 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.805230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.805232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.805353 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.805675 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.805679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.805681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.805945 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.806052 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.806443 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.806695 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":35}
I20260811 01:31:36.811998 31219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Bootstrap starting.
I20260811 01:31:36.815829 31219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:36.817092 31219 log.cc:824] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:36.820253 31219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: No bootstrap required, opened a new log
I20260811 01:31:36.828457 31219 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } }
I20260811 01:31:36.828872 31219 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:36.828990 31219 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa83e547dda042a6bd7eeb88e17e8606, State: Initialized, Role: FOLLOWER
I20260811 01:31:36.829598 31219 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } }
I20260811 01:31:36.830587 31229 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } }
I20260811 01:31:36.830886 31229 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:36.831760 31219 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:31:36.841279 31241 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:31:36.841454 31241 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:31:36.845248 31144 master_runner.cc:428] Detected that this master aa83e547dda042a6bd7eeb88e17e8606 is joining an existing cluster
I20260811 01:31:36.845391 31144 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.39.253:34987
I20260811 01:31:36.873250 31225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.853520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45394 (local address 127.23.39.253:34987)
0811 01:31:36.853737 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.853745 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.855562 (+ 1817us) server_negotiation.cc:407] Connection header received
0811 01:31:36.855809 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.855820 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.855896 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.855969 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.857706 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.858893 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.861414 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.862218 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.862379 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.865886 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.865892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.865897 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.865939 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.869910 (+ 3971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.870877 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.870883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.870887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.871066 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.871500 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.871504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.871507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.871918 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.872048 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.872576 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.872848 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:31:36.874307 31248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.853724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45394)
0811 01:31:36.855445 (+ 1721us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.855473 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.855683 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.856199 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.856206 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.857100 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.857528 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.857544 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.859158 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.859165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.861246 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.861265 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.862680 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.862689 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.863016 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.864272 (+ 1256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.864297 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.865669 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.870092 (+ 4423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.870097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.870101 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.870712 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.871203 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.871207 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.871211 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.871385 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.872134 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.872138 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.872295 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.873467 (+ 1172us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.873804 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1551,"mutex_wait_us":75,"spinlock_wait_cycles":43904,"thread_start_us":1322,"threads_started":1}
I20260811 01:31:36.875173 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.853626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40374 (local address 127.23.39.254:36077)
0811 01:31:36.853847 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.853853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.855252 (+ 1399us) server_negotiation.cc:407] Connection header received
0811 01:31:36.855585 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.855593 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.855702 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.855795 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.857579 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.858771 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.861256 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.862056 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.862271 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.865926 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.865936 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.865944 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.865993 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.870663 (+ 4670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.871683 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.871691 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.871697 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.871876 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.872371 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.872378 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.872385 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.872805 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.872961 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.874182 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.874795 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:31:36.876754 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.853522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40374)
0811 01:31:36.855087 (+ 1565us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.855115 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.855394 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.856046 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.856051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.856880 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.857347 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.857365 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.858991 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.858996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.861049 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.861075 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.862610 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.862618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.862860 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.864030 (+ 1170us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.864061 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.865680 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.870874 (+ 5194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.870882 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.870888 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.871496 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.872034 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.872041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.872047 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.872240 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.873080 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.873087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.873799 (+ 712us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.875672 (+ 1873us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.876064 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1336,"mutex_wait_us":179,"spinlock_wait_cycles":76544,"thread_start_us":1090,"threads_started":1}
WARNING: no policy specified for oryx/127.23.39.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.252@KRBTEST.COM" created.
Aug 11 01:31:36 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411894, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.254@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
I20260811 01:31:36.905963 31251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.884431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45402)
0811 01:31:36.885157 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.885211 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:36.885414 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:36.886015 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:36.886026 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:36.887117 (+ 1091us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:36.887495 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.887512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.888994 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.889002 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.890773 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:36.890792 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.892040 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.892048 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:36.892324 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.893263 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:36.893294 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:36.896801 (+ 3507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:36.901961 (+ 5160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.901981 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.901991 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.902857 (+ 866us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.903537 (+ 680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:36.903542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:36.903547 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:36.903750 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:36.904613 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:36.904622 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:36.904870 (+ 248us) client_negotiation.cc:769] Sending connection context
0811 01:31:36.905091 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 01:31:36.905476 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":5769,"threads_started":1}
I20260811 01:31:36.906044 31225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.884502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45402 (local address 127.23.39.253:34987)
0811 01:31:36.884706 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:36.884712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:36.885319 (+ 607us) server_negotiation.cc:407] Connection header received
0811 01:31:36.885685 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:36.885691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:36.885819 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:36.885940 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:36.887689 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.888834 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.890995 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:36.891745 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:36.891906 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:36.897102 (+ 5196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:36.897112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:36.897129 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:36.897185 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:36.901738 (+ 4553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.903170 (+ 1432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.903178 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.903184 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.903381 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:36.903949 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:36.903958 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:36.903965 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:36.904442 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:36.904634 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:36.905260 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 01:31:36.905572 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:31:36.908720 30609 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.39.253:34987: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606"
member_type: NON_VOTER
last_known_addr {
host: "127.23.39.253"
port: 34987
}
attrs {
promote: true
}
}
dest_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0"
cas_config_opid_index: -1
I20260811 01:31:36.910084 30609 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } }
I20260811 01:31:36.917088 31254 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:36.918864 31194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:36.922593 31254 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.39.253:34987
I20260811 01:31:36.923383 31255 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:36.923868 31144 master.cc:537] Master@127.23.39.253:34987 shutting down...
I20260811 01:31:36.923899 31255 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:36.923942 31194 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.252.keytab.
Entry for principal oryx/127.23.39.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.252.keytab.
I20260811 01:31:36.925586 31254 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:36.926842 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:44117
--webserver_interface=127.23.39.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.252.keytab
--principal=oryx/127.23.39.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:36.928560 30591 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 01:31:36.942456 31144 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:36.943128 31144 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:36.943418 31144 tablet_replica.cc:330] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: stopping tablet replica
I20260811 01:31:36.957446 31144 master.cc:552] Master@127.23.39.253:34987 shutdown complete.
I20260811 01:31:36.957631 31144 master_runner.cc:305] Clearing existing system tablet
I20260811 01:31:36.970077 31144 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:36.970296 31144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:36.972209 31251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:36.971683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45418)
0811 01:31:36.971869 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:36.971998 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 01:31:36.972612 30591 consensus_peers.cc:487] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 -> Peer aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253:34987): Couldn't send request to peer aa83e547dda042a6bd7eeb88e17e8606. Status: Network error: Client connection negotiation failed: client connection to 127.23.39.253:34987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 01:31:36.973980 31144 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 01:31:36.976265 31262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:36.976687 31144 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:36.977037 31144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 01:31:36.977151 31144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "aa83e547dda042a6bd7eeb88e17e8606"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "f98cf063e93b0562ab02807de33a20f6"
server_key_iv: "947814af6468759df3400555e1386647"
server_key_version: "encryptionkey@0"
I20260811 01:31:36.983795 31144 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:36.992946 31144 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:31:36.993189 31144 log.cc:1196] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 01:31:36.993765 31144 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Deleting consensus metadata
I20260811 01:31:36.994104 31144 master_runner.cc:315] Copying system tablet from 127.23.39.254:36077
I20260811 01:31:37.070644 31144 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: tablet copy: Beginning tablet copy session from remote peer at address 127.23.39.254:36077
I20260811 01:31:37.091733 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.071619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.23.39.254:36077)
0811 01:31:37.071831 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.071839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.072498 (+ 659us) server_negotiation.cc:407] Connection header received
0811 01:31:37.072829 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.072838 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.072937 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.073023 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.074597 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.075952 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.078634 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.079567 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.079689 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.083161 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.083170 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.083177 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.083231 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.087648 (+ 4417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.088708 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.088717 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.088723 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.088917 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.089505 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.089512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.089517 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.089979 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.090162 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.090875 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.091173 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:31:37.093470 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.071629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40378)
0811 01:31:37.072365 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.072390 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.072638 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.073311 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.073318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.073984 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.074384 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.074403 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.076520 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.076529 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.078434 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.078454 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.080076 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.080085 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.080369 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.081200 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.081234 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.082832 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.087856 (+ 5024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.087865 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.087872 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.088541 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.089103 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.089110 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.089117 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.089356 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.090260 (+ 904us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.090268 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.090505 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.092383 (+ 1878us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.092834 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":407,"threads_started":1}
I20260811 01:31:37.094830 30631 tablet_copy_service.cc:140] P e16e9c9d22ac47bea3828f9451b5cfc0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer aa83e547dda042a6bd7eeb88e17e8606 ({username='oryx', principal='oryx/127.23.39.253@KRBTEST.COM'} at 127.0.0.1:40378)
I20260811 01:31:37.095197 30631 tablet_copy_service.cc:161] P e16e9c9d22ac47bea3828f9451b5cfc0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer aa83e547dda042a6bd7eeb88e17e8606 at {username='oryx', principal='oryx/127.23.39.253@KRBTEST.COM'} at 127.0.0.1:40378: session id = aa83e547dda042a6bd7eeb88e17e8606-00000000000000000000000000000000
I20260811 01:31:37.103312 30631 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:31:37.106217 31144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:31:37.115402 31144 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: tablet copy: Starting download of 0 data blocks...
I20260811 01:31:37.115859 31144 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: tablet copy: Starting download of 1 WAL segments...
I20260811 01:31:37.119311 31144 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:31:37.125304 30631 tablet_copy_service.cc:342] P e16e9c9d22ac47bea3828f9451b5cfc0: Request end of tablet copy session aa83e547dda042a6bd7eeb88e17e8606-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.39.253@KRBTEST.COM'} at 127.0.0.1:40378
I20260811 01:31:37.125595 30631 tablet_copy_service.cc:433] P e16e9c9d22ac47bea3828f9451b5cfc0: ending tablet copy session aa83e547dda042a6bd7eeb88e17e8606-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer aa83e547dda042a6bd7eeb88e17e8606
I20260811 01:31:37.141685 31144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:37.151882 31271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:37.167047 31272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:37.174221 31144 server_base.cc:1034] running on GCE node
W20260811 01:31:37.175187 31274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:37.175892 31144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:37.183025 31144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:37.190671 31144 hybrid_clock.cc:648] HybridClock initialized: now 1786411897190571 us; error 75 us; skew 500 ppm
I20260811 01:31:37.191150 31144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411897, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:37.194216 31144 init.cc:377] Logged in from keytab as oryx/127.23.39.253@KRBTEST.COM (short username oryx)
I20260811 01:31:37.214781 31138 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
I20260811 01:31:37.217427 31144 webserver.cc:460] Webserver started at http://127.23.39.253:37075/ using document root <none> and password file <none>
I20260811 01:31:37.218120 31144 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:37.218389 31144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:37.239102 31144 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.008s sys 0.012s
I20260811 01:31:37.248163 31282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:37.248814 31144 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.007s
I20260811 01:31:37.249061 31144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "aa83e547dda042a6bd7eeb88e17e8606"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "f98cf063e93b0562ab02807de33a20f6"
server_key_iv: "947814af6468759df3400555e1386647"
server_key_version: "encryptionkey@0"
I20260811 01:31:37.249368 31144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:37.284137 31144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:37.289608 31144 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260811 01:31:37.504065 31258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:37.504492 31258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:37.504681 31258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:37.515455 31258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:37.515756 31258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:37.515926 31258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:37.516095 31258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:37.516245 31258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:37.517705 31339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.516313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45434)
0811 01:31:37.517250 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.517414 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:34987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":603,"threads_started":1}
I20260811 01:31:37.519992 31345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.253:34987 every 8 connection(s)
I20260811 01:31:37.520263 31144 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.253:34987
I20260811 01:31:37.521363 31144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
I20260811 01:31:37.529047 31347 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:31:37.531993 31347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Bootstrap starting.
I20260811 01:31:37.534088 31258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.252.keytab
--principal=oryx/127.23.39.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:44117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.39.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:37.535974 31258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:37.537791 31258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:31:37.538327 31339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.519389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45440)
0811 01:31:37.519597 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.519618 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.519801 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.521695 (+ 1894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.521701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.522290 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.522536 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.522552 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.524925 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.524930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.526423 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.526443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.527830 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.527837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.528029 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.528852 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.528877 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.530108 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.535096 (+ 4988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.535101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.535104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.535706 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.536239 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.536244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.536247 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.536432 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.537232 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.537239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.537408 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.537559 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.537902 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 01:31:37.539160 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.520499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45440 (local address 127.23.39.253:34987)
0811 01:31:37.521213 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.521221 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.521248 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:31:37.521326 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.521333 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.521442 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.521635 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.522765 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.524690 (+ 1925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.526634 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.527402 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.527531 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.530433 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.530444 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.530449 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.530489 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.534875 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.535873 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.535879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.535882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.536073 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.536576 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.536581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.536584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.536982 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.537156 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.538445 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.538719 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":377,"threads_started":1}
I20260811 01:31:37.550202 31347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:31:37.550956 31347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: Bootstrap complete.
I20260811 01:31:37.552448 31347 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } }
W20260811 01:31:37.553857 31351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:37.553938 31352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:37.552984 31347 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa83e547dda042a6bd7eeb88e17e8606, State: Initialized, Role: LEARNER
I20260811 01:31:37.554910 31347 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } }
I20260811 01:31:37.556617 31347 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:37.556831 31314 raft_consensus.cc:1203] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
W20260811 01:31:37.560647 31354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:37.556375 31356 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.563233 31356 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:31:37.566701 31258 server_base.cc:1034] running on GCE node
I20260811 01:31:37.568118 31258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:37.568063 31356 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16e9c9d22ac47bea3828f9451b5cfc0. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.568898 31356 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:31:37.570561 31258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:37.571851 31258 hybrid_clock.cc:648] HybridClock initialized: now 1786411897571778 us; error 58 us; skew 500 ppm
I20260811 01:31:37.572392 31258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411897, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:37.576201 31369 catalog_manager.cc:1259] Loaded cluster ID: 443b9196818c4da5a418f427eb274cd5
I20260811 01:31:37.576313 31369 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: loading cluster ID for follower catalog manager: success
I20260811 01:31:37.576718 31258 init.cc:377] Logged in from keytab as oryx/127.23.39.252@KRBTEST.COM (short username oryx)
I20260811 01:31:37.578727 31258 webserver.cc:460] Webserver started at http://127.23.39.252:37803/ using document root <none> and password file <none>
I20260811 01:31:37.579190 31369 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: acquiring CA information for follower catalog manager: success
I20260811 01:31:37.579555 31258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:37.579696 31258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:37.580019 31258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:37.581215 31369 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:31:37.583397 31258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/instance:
uuid: "e43253350cb54f0bb531fac4a0d6105e"
format_stamp: "Formatted at 2026-08-11 01:31:37 on dist-test-slave-9jjr"
server_key: "3c8762d77e20e84be488daafa94dd7f0"
server_key_iv: "aec21be84fe297832e78a566a527f5af"
server_key_version: "encryptionkey@0"
I20260811 01:31:37.584223 31258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal/instance:
uuid: "e43253350cb54f0bb531fac4a0d6105e"
format_stamp: "Formatted at 2026-08-11 01:31:37 on dist-test-slave-9jjr"
server_key: "3c8762d77e20e84be488daafa94dd7f0"
server_key_iv: "aec21be84fe297832e78a566a527f5af"
server_key_version: "encryptionkey@0"
I20260811 01:31:37.589779 31258 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260811 01:31:37.593690 31374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:37.595108 31258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 01:31:37.595314 31258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "e43253350cb54f0bb531fac4a0d6105e"
format_stamp: "Formatted at 2026-08-11 01:31:37 on dist-test-slave-9jjr"
server_key: "3c8762d77e20e84be488daafa94dd7f0"
server_key_iv: "aec21be84fe297832e78a566a527f5af"
server_key_version: "encryptionkey@0"
I20260811 01:31:37.595525 31258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:37.615481 31258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:37.620389 31258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:37.620714 31258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:37.642373 31258 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.252:44117
I20260811 01:31:37.642397 31433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.252:44117 every 8 connection(s)
I20260811 01:31:37.644084 31258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
I20260811 01:31:37.648345 31434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:37.652011 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 31258
I20260811 01:31:37.657466 31434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411897, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.252@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:37.679874 31439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.660545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.23.39.254:36077)
0811 01:31:37.662384 (+ 1839us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.662390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.662409 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:31:37.662467 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.662472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.662548 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.662669 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.664263 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.665449 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.667586 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.668033 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.668135 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.672359 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.672369 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.672377 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.672428 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.676060 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.677042 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.677049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.677054 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.677244 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.677793 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.677799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.677802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.678238 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.678397 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.679219 (+ 822us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.679503 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1718,"thread_start_us":1586,"threads_started":1}
I20260811 01:31:37.680918 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.654575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37484 (local address 127.23.39.252:44117)
0811 01:31:37.655498 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.655511 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.655553 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:31:37.657425 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.657453 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.657934 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.658413 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.660338 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.662579 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.664548 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.665633 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.665838 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.671558 (+ 5720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.671569 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.671584 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.671624 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.675772 (+ 4148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.676932 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.676939 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.676941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.677291 (+ 350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.677793 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.677799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.677802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.678686 (+ 884us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.679033 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.679403 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.679710 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":692,"spinlock_wait_cycles":17664,"thread_start_us":426,"threads_started":1}
I20260811 01:31:37.680958 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.660532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40392)
0811 01:31:37.661670 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.661718 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.661866 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.662803 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.662811 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.663750 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.664102 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.664115 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.665611 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.665615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.667416 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.667437 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.668293 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.668302 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.668527 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.669270 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.669308 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.672112 (+ 2804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.676220 (+ 4108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.676235 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.676250 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.676892 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.677437 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.677442 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.677445 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.677668 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.678375 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.678381 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.678598 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.678993 (+ 395us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.679559 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":648,"threads_started":1}
I20260811 01:31:37.682813 31434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411897, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.252@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
I20260811 01:31:37.697471 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.683824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45442 (local address 127.23.39.253:34987)
0811 01:31:37.684045 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.684052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.684361 (+ 309us) server_negotiation.cc:407] Connection header received
0811 01:31:37.684556 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.684561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.684645 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.684761 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.685499 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.686329 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.687696 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.688184 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.688328 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.691770 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.691776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.691779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.691812 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.694670 (+ 2858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.695464 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.695470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.695474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.695618 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.696008 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.696014 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.696017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.696330 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.696494 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.696869 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.697097 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 01:31:37.697460 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.683958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45442)
0811 01:31:37.684253 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.684277 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.684428 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.684785 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.684790 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.685198 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.685351 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.685359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.686479 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.686486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.687547 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.687559 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.688345 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.688351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.688536 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.689232 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.689251 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.691561 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.694883 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.694888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.694893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.695334 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.695735 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.695740 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.695743 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.695897 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.696450 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.696455 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.696610 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.696754 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.697089 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186}
I20260811 01:31:37.699056 31434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411897, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.252@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
I20260811 01:31:37.711483 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.699834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.0.0.1:37490)
0811 01:31:37.700004 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.700023 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.700129 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.700381 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.700384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.700777 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.700944 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.700952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.701999 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.702003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.703006 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.703018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.703663 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.703666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.703835 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.704372 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.704389 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.706463 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.709287 (+ 2824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.709291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.709294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.709668 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.709983 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.709986 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.709988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.710195 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.710684 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.710687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.710835 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.710939 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.711146 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:31:37.711575 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.699929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37490 (local address 127.23.39.252:44117)
0811 01:31:37.700062 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.700067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.700083 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:31:37.700204 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.700207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.700262 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.700344 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.701094 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.701892 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.703140 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.703539 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.703639 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.706640 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.706645 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.706648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.706676 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.709157 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.709769 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.709772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.709774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.709890 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.710300 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.710304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.710306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.710583 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.710695 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.711052 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.711262 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":36}
I20260811 01:31:37.716470 31434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Bootstrap starting.
I20260811 01:31:37.719951 31434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:37.721251 31434 log.cc:824] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:37.724468 31434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: No bootstrap required, opened a new log
I20260811 01:31:37.732514 31434 raft_consensus.cc:348] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } }
I20260811 01:31:37.732947 31434 raft_consensus.cc:374] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:37.733098 31434 raft_consensus.cc:729] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43253350cb54f0bb531fac4a0d6105e, State: Initialized, Role: FOLLOWER
I20260811 01:31:37.733695 31434 consensus_queue.cc:260] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } }
I20260811 01:31:37.734794 31442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } } }
I20260811 01:31:37.735266 31442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:37.736099 31434 sys_catalog.cc:564] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:31:37.745728 31454 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:31:37.746011 31454 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:31:37.750201 31258 master_runner.cc:428] Detected that this master e43253350cb54f0bb531fac4a0d6105e is joining an existing cluster
I20260811 01:31:37.750349 31258 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.39.252:44117
I20260811 01:31:37.775328 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.755223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45458 (local address 127.23.39.253:34987)
0811 01:31:37.755386 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.755393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.756255 (+ 862us) server_negotiation.cc:407] Connection header received
0811 01:31:37.756563 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.756573 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.756674 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.756791 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.758964 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.760138 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.762425 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.763184 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.763302 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.767406 (+ 4104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.767416 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.767421 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.767470 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.771396 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.772755 (+ 1359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.772761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.772776 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.772990 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.773551 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.773556 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.773560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.773914 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.774064 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.774719 (+ 655us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.774978 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:31:37.775380 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.756376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37500 (local address 127.23.39.252:44117)
0811 01:31:37.756545 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.756551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.757381 (+ 830us) server_negotiation.cc:407] Connection header received
0811 01:31:37.758192 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.758199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.758282 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.758366 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.760090 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.761331 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.764336 (+ 3005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.765112 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.765214 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.768233 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.768242 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.768248 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.768296 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.772051 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.772867 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.772873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.772879 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.773051 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.773518 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.773526 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.773530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.773938 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.774063 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.774687 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.774935 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:31:37.776214 31439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.755147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.23.39.254:36077)
0811 01:31:37.755359 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.755366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.758067 (+ 2701us) server_negotiation.cc:407] Connection header received
0811 01:31:37.758398 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.758406 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.758501 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.758579 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.760326 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.761476 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.763828 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.764669 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.764779 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.768023 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.768030 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.768035 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.768081 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.772724 (+ 4643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.773658 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.773664 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.773668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.773838 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.774421 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.774426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.774430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.774831 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.774975 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.775648 (+ 673us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.775889 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:31:37.776515 31465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.756274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.0.0.1:37500)
0811 01:31:37.757276 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.757295 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.757453 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.758555 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.758562 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.759429 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.759908 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.759924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.761540 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.761544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.764158 (+ 2614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.764175 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.765555 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.765561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.765769 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.766662 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.766685 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.768029 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.772178 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.772188 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.772191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.772758 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.773179 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.773186 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.773189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.773367 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.774172 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.774176 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.774425 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.775616 (+ 1191us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.775968 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":30,"spinlock_wait_cycles":1408,"thread_start_us":581,"threads_started":1}
I20260811 01:31:37.776701 31464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.755353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45458)
0811 01:31:37.756043 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.756062 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.756381 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.757083 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.757090 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.758247 (+ 1157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.758734 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.758748 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.760330 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.760334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.762217 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.762232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.763676 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.763682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.763880 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.764727 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.764762 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.767123 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.771597 (+ 4474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.771605 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.771609 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.772588 (+ 979us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.773146 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.773150 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.773153 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.773401 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.774167 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.774172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.774437 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.775616 (+ 1179us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.776159 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":210,"spinlock_wait_cycles":55808,"thread_start_us":374,"threads_started":1}
I20260811 01:31:37.777601 31467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.757070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40396)
0811 01:31:37.757953 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.757970 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.758204 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.758815 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.758820 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.759611 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.760103 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.760117 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.761682 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.761687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.763625 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.763640 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.765101 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.765108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.765314 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.766219 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.766246 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.767775 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.772922 (+ 5147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.772928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.772934 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.773494 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.774024 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.774029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.774032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.774241 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.775076 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.775082 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.775323 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.776487 (+ 1164us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.777131 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":69,"thread_start_us":458,"threads_started":1}
I20260811 01:31:37.779028 31442 raft_consensus.cc:482] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:37.779341 31442 raft_consensus.cc:504] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } }
I20260811 01:31:37.780920 31442 leader_election.cc:288] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077), aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253:34987)
I20260811 01:31:37.781490 31314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e43253350cb54f0bb531fac4a0d6105e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa83e547dda042a6bd7eeb88e17e8606" is_pre_election: true
I20260811 01:31:37.781518 30620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e43253350cb54f0bb531fac4a0d6105e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" is_pre_election: true
I20260811 01:31:37.782523 31376 leader_election.cc:302] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43253350cb54f0bb531fac4a0d6105e; no voters: aa83e547dda042a6bd7eeb88e17e8606, e16e9c9d22ac47bea3828f9451b5cfc0
I20260811 01:31:37.782948 31442 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 01:31:37.787545 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30678
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.193@KRBTEST.COM
I20260811 01:31:37.809746 31468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.788691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.23.39.193:33643)
0811 01:31:37.789442 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.789449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.789475 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:31:37.789530 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.789536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.789747 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.789880 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.791668 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.792838 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.794694 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.795286 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.795390 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.801383 (+ 5993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.801398 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.801412 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.801451 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.804967 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.805849 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.805857 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.805859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.806010 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.806594 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.806601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.806605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.807141 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.807499 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.808931 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.809243 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":399,"threads_started":1}
I20260811 01:31:37.811570 30822 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 11 01:31:37 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411894, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.254@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
I20260811 01:31:37.826390 31339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.808013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.0.0.1:37514)
0811 01:31:37.808647 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.808668 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.808836 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.809275 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.809282 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.809731 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.810007 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.810019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.811129 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.811135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.812489 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.812508 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.813371 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.813377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.813595 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.814570 (+ 975us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.814600 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.818063 (+ 3463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.823169 (+ 5106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.823176 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.823181 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.823776 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.824261 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.824266 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.824270 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.824449 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.825245 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.825250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.825433 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.825606 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.825946 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489}
I20260811 01:31:37.826467 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.808430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.23.39.252:44117)
0811 01:31:37.808632 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.808638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.808749 (+ 111us) server_negotiation.cc:407] Connection header received
0811 01:31:37.809004 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.809016 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.809117 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.809238 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.810210 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.810970 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.812643 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.813200 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.813345 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.818389 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.818396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.818401 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.818446 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.822954 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.823919 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.823927 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.823932 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.824118 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.824573 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.824580 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.824584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.825086 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.825278 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.825750 (+ 472us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.826073 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:31:37.828449 30609 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.39.252:44117: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e"
member_type: NON_VOTER
last_known_addr {
host: "127.23.39.252"
port: 44117
}
attrs {
promote: true
}
}
dest_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0"
cas_config_opid_index: 5
I20260811 01:31:37.829548 30609 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
I20260811 01:31:37.832185 31314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:31:37.832875 31330 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e43253350cb54f0bb531fac4a0d6105e (127.23.39.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.835096 31408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:37.839551 31408 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 01:31:37.848537 31470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 01:31:37.852878 31472 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:37.855731 31330 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.39.252:44117
I20260811 01:31:37.861617 31258 master.cc:537] Master@127.23.39.252:44117 shutting down...
I20260811 01:31:37.861812 31470 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.862284 31470 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:37.863102 31314 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e43253350cb54f0bb531fac4a0d6105e (127.23.39.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.869220 31356 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.869573 31356 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: LEARNER
I20260811 01:31:37.870858 31330 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: attempting to promote NON_VOTER aa83e547dda042a6bd7eeb88e17e8606 to VOTER
I20260811 01:31:37.871747 31330 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
W20260811 01:31:37.874814 31380 tablet.cc:2369] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:31:37.874886 31314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 LEARNER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 01:31:37.875512 31472 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 01:31:37.878472 30591 consensus_peers.cc:487] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 -> Peer e43253350cb54f0bb531fac4a0d6105e (127.23.39.252:44117): Couldn't send request to peer e43253350cb54f0bb531fac4a0d6105e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 01:31:37.879877 31472 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.883255 31313 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.887988 31408 raft_consensus.cc:858] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
W20260811 01:31:37.888234 31408 raft_consensus.cc:1565] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
I20260811 01:31:37.890626 31330 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.890945 31330 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:37.891250 31330 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.891489 31330 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:37.893019 31356 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:37.893293 31356 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:37.903512 31408 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.908802 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.909271 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:31:37.909247 31442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16e9c9d22ac47bea3828f9451b5cfc0. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.909536 31442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:31:37.909607 31481 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: NON_VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: true } } }
I20260811 01:31:37.909970 31481 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 01:31:37.912171 31258 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 01:31:37.912669 31258 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 01:31:37.912869 31258 tablet_replica.cc:330] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: stopping tablet replica
I20260811 01:31:37.920900 31258 master.cc:552] Master@127.23.39.252:44117 shutdown complete.
I20260811 01:31:37.920997 31258 master_runner.cc:305] Clearing existing system tablet
I20260811 01:31:37.921347 31258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:37.921470 31258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:37.923869 31258 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 01:31:37.925493 31483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:37.925978 31258 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:37.926317 31258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 01:31:37.926430 31258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "e43253350cb54f0bb531fac4a0d6105e"
format_stamp: "Formatted at 2026-08-11 01:31:37 on dist-test-slave-9jjr"
server_key: "3c8762d77e20e84be488daafa94dd7f0"
server_key_iv: "aec21be84fe297832e78a566a527f5af"
server_key_version: "encryptionkey@0"
I20260811 01:31:37.930473 31258 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:37.935863 31258 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 01:31:37.936103 31258 log.cc:1196] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 01:31:37.936717 31258 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Deleting consensus metadata
I20260811 01:31:37.936990 31258 master_runner.cc:315] Copying system tablet from 127.23.39.254:36077
I20260811 01:31:37.939899 31258 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: tablet copy: Beginning tablet copy session from remote peer at address 127.23.39.254:36077
I20260811 01:31:37.961910 31439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.940772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40408 (local address 127.23.39.254:36077)
0811 01:31:37.941065 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:37.941075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:37.947657 (+ 6582us) server_negotiation.cc:407] Connection header received
0811 01:31:37.947951 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:37.947963 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:37.948039 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:37.948157 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:37.949218 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.950118 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.951891 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.952392 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.952547 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.955029 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:37.955035 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:37.955038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:37.955082 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:37.958475 (+ 3393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.959383 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.959389 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.959393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.959551 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:37.960276 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:37.960283 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:37.960286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:37.960629 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:37.960810 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:37.961239 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 01:31:37.961484 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260811 01:31:37.961930 31490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:37.940730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40408)
0811 01:31:37.947496 (+ 6766us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:37.947517 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:37.947748 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:37.948191 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:37.948195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:37.948705 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:37.948962 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.948972 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.950343 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.950350 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.951717 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:37.951735 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:37.952822 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:37.952831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:37.952984 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:37.953760 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:37.953783 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:37.954791 (+ 1008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:37.958639 (+ 3848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.958645 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.958649 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.959214 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.959695 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:37.959700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:37.959704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:37.960124 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:37.960769 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:37.960774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:37.960964 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 01:31:37.961129 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 01:31:37.961486 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6594,"thread_start_us":6295,"threads_started":1}
I20260811 01:31:37.963109 30631 tablet_copy_service.cc:140] P e16e9c9d22ac47bea3828f9451b5cfc0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e43253350cb54f0bb531fac4a0d6105e ({username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:40408)
I20260811 01:31:37.963310 30631 tablet_copy_service.cc:161] P e16e9c9d22ac47bea3828f9451b5cfc0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e43253350cb54f0bb531fac4a0d6105e at {username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:40408: session id = e43253350cb54f0bb531fac4a0d6105e-00000000000000000000000000000000
I20260811 01:31:37.965664 30631 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 01:31:37.967541 31258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 01:31:37.972230 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30678
I20260811 01:31:37.976589 31258 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: tablet copy: Starting download of 0 data blocks...
I20260811 01:31:37.977093 31258 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: tablet copy: Starting download of 1 WAL segments...
I20260811 01:31:37.984303 31258 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 01:31:37.989928 30631 tablet_copy_service.cc:342] P e16e9c9d22ac47bea3828f9451b5cfc0: Request end of tablet copy session e43253350cb54f0bb531fac4a0d6105e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:40408
I20260811 01:31:37.990104 30631 tablet_copy_service.cc:433] P e16e9c9d22ac47bea3828f9451b5cfc0: ending tablet copy session e43253350cb54f0bb531fac4a0d6105e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e43253350cb54f0bb531fac4a0d6105e
I20260811 01:31:38.001609 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:33643
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:36077
--webserver_port=36663
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:31:38.003157 31258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:38.005920 31491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:38.012019 31492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:38.012980 31494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:38.013921 31258 server_base.cc:1034] running on GCE node
I20260811 01:31:38.014333 31258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:38.015048 31258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:38.016255 31258 hybrid_clock.cc:648] HybridClock initialized: now 1786411898016191 us; error 48 us; skew 500 ppm
I20260811 01:31:38.016510 31258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411898, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:38.018838 31258 init.cc:377] Logged in from keytab as oryx/127.23.39.252@KRBTEST.COM (short username oryx)
I20260811 01:31:38.023161 31258 webserver.cc:460] Webserver started at http://127.23.39.252:44029/ using document root <none> and password file <none>
I20260811 01:31:38.023551 31258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:38.023669 31258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:38.027261 31258 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 01:31:38.029567 31502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:38.030059 31258 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 01:31:38.030264 31258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "e43253350cb54f0bb531fac4a0d6105e"
format_stamp: "Formatted at 2026-08-11 01:31:37 on dist-test-slave-9jjr"
server_key: "3c8762d77e20e84be488daafa94dd7f0"
server_key_iv: "aec21be84fe297832e78a566a527f5af"
server_key_version: "encryptionkey@0"
I20260811 01:31:38.030514 31258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:38.061138 31258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:38.065791 31258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:38.096210 31258 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.252:44117
I20260811 01:31:38.096278 31565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.252:44117 every 8 connection(s)
I20260811 01:31:38.097416 31258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
I20260811 01:31:38.103652 31566 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:31:38.107581 31566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Bootstrap starting.
I20260811 01:31:38.124289 31566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:31:38.124943 31566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Bootstrap complete.
I20260811 01:31:38.126281 31566 raft_consensus.cc:348] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
I20260811 01:31:38.126612 31566 raft_consensus.cc:729] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e43253350cb54f0bb531fac4a0d6105e, State: Initialized, Role: LEARNER
I20260811 01:31:38.126911 31566 consensus_queue.cc:260] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } }
I20260811 01:31:38.127913 31569 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:38.128234 31566 sys_catalog.cc:564] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:38.128427 31569 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: LEARNER
I20260811 01:31:38.144945 31582 catalog_manager.cc:1259] Loaded cluster ID: 443b9196818c4da5a418f427eb274cd5
I20260811 01:31:38.145076 31582 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: loading cluster ID for follower catalog manager: success
I20260811 01:31:38.148691 31582 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: acquiring CA information for follower catalog manager: success
I20260811 01:31:38.151346 31582 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:31:38.353729 31583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.337117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.0.0.1:37526)
0811 01:31:38.338068 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:38.338095 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:38.338292 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:38.347887 (+ 9595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:38.347894 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:38.347934 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:38.348147 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.348157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.349538 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.349542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.351165 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.351181 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.353002 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.353007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.353146 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.353191 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:31:38.353259 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 01:31:38.353366 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":689,"threads_started":1}
I20260811 01:31:38.353896 31584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.337384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37526 (local address 127.23.39.252:44117)
0811 01:31:38.347430 (+ 10046us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:38.347435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:38.347458 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:31:38.347533 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:38.347536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:38.347626 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:38.347802 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:38.348350 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.349373 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.351353 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.352814 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.352976 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.353260 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:38.353324 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 01:31:38.353496 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9888,"thread_start_us":9688,"threads_started":1}
I20260811 01:31:38.354868 31536 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 01:31:38.355335 31569 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16e9c9d22ac47bea3828f9451b5cfc0. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:38.355621 31569 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: LEARNER
W20260811 01:31:38.395506 31495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:38.395872 31495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:38.396031 31495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:38.404019 31495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:38.404174 31495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:38.404362 31495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:38.414917 31495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:33643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=36663
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:38.416353 31495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:38.417825 31495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:38.433413 31590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:38.433414 31591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:38.433352 31593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:38.434294 31495 server_base.cc:1034] running on GCE node
I20260811 01:31:38.434998 31495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:38.436082 31495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:38.437369 31495 hybrid_clock.cc:648] HybridClock initialized: now 1786411898437321 us; error 42 us; skew 500 ppm
I20260811 01:31:38.437726 31495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411898, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:38.441322 31495 init.cc:377] Logged in from keytab as oryx/127.23.39.193@KRBTEST.COM (short username oryx)
I20260811 01:31:38.442947 31495 webserver.cc:460] Webserver started at http://127.23.39.193:36663/ using document root <none> and password file <none>
I20260811 01:31:38.443652 31495 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:38.443786 31495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:38.449532 31495 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:31:38.452521 31601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:38.454037 31495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:31:38.454242 31495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "86163ec230ce4d78b4020696079083d2"
format_stamp: "Formatted at 2026-08-11 01:31:34 on dist-test-slave-9jjr"
server_key: "24d9a8d00ae1d611f0e99ab4e266736b"
server_key_iv: "d38e97df6603989af9fc81aa20cd7968"
server_key_version: "encryptionkey@0"
I20260811 01:31:38.455322 31495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:38.478303 31495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:38.483152 31495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:38.483474 31495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:38.484540 31495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:38.486033 31495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:38.486203 31495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:38.486331 31495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:38.486426 31495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:38.526917 31495 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33643
I20260811 01:31:38.526989 31728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33643 every 8 connection(s)
I20260811 01:31:38.528661 31495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:38.534314 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 31495
I20260811 01:31:38.534740 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30836
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411898, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411898, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411898, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
Aug 11 01:31:38 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.194@KRBTEST.COM
I20260811 01:31:38.583087 31584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.532905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:55077 (local address 127.23.39.252:44117)
0811 01:31:38.533164 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:38.533173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:38.553904 (+ 20731us) server_negotiation.cc:407] Connection header received
0811 01:31:38.559976 (+ 6072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:38.559982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:38.560088 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:38.560179 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:38.563359 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.564515 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.567541 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.568200 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.568311 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.575891 (+ 7580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:38.575900 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:38.575905 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:38.575948 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:38.579768 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.580573 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.580578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.580581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.580759 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.581300 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.581305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.581307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.581763 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:38.581901 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:38.582478 (+ 577us) server_negotiation.cc:299] Negotiation successful
0811 01:31:38.582753 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:31:38.583559 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.533326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:52545)
0811 01:31:38.557935 (+ 24609us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:38.557961 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:38.559587 (+ 1626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:38.560721 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:38.560735 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:38.561845 (+ 1110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:38.563122 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.563157 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.565239 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.565244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.567355 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.567370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.568721 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.568730 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.569103 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.570198 (+ 1095us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:38.570222 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:38.573612 (+ 3390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:38.577923 (+ 4311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.577937 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.577958 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.578781 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.579334 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.579340 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.579343 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.579601 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.580391 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:38.580400 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:38.580901 (+ 501us) client_negotiation.cc:769] Sending connection context
0811 01:31:38.581282 (+ 381us) client_negotiation.cc:240] Negotiation successful
0811 01:31:38.581887 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24408,"mutex_wait_us":284,"spinlock_wait_cycles":13184,"thread_start_us":21192,"threads_started":1}
I20260811 01:31:38.584674 31732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.532272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.23.39.193:55077)
0811 01:31:38.553621 (+ 21349us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:38.553717 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:38.559587 (+ 5870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:38.560721 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:38.560735 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:38.561845 (+ 1110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:38.563122 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.563163 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.564727 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.564733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.567355 (+ 2622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.567370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.568721 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.568730 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.569108 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.570065 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:38.570182 (+ 117us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:38.575611 (+ 5429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:38.579929 (+ 4318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.579933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.579936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.580436 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.580917 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.580925 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.580931 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.581158 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.581978 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:38.581982 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:38.582181 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 01:31:38.583590 (+ 1409us) client_negotiation.cc:240] Negotiation successful
0811 01:31:38.584200 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1176,"mutex_wait_us":271,"spinlock_wait_cycles":70528,"thread_start_us":2723,"threads_started":1}
I20260811 01:31:38.585067 31733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.532972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:52545 (local address 127.23.39.254:36077)
0811 01:31:38.554939 (+ 21967us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:38.554944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:38.558224 (+ 3280us) server_negotiation.cc:407] Connection header received
0811 01:31:38.560114 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:38.560122 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:38.560211 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:38.560311 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:38.563357 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.564494 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.567541 (+ 3047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.568235 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.568323 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.573851 (+ 5528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:38.573858 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:38.573863 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:38.573907 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:38.577795 (+ 3888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.578945 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.578951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.578955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.579177 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.579757 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.579762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.579765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.580164 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:38.580313 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:38.584344 (+ 4031us) server_negotiation.cc:299] Negotiation successful
0811 01:31:38.584621 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21856,"thread_start_us":21727,"threads_started":1}
I20260811 01:31:38.586398 31729 heartbeater.cc:347] Connected to a master server at 127.23.39.252:44117
I20260811 01:31:38.586444 31730 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:38.586752 31729 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:38.586759 31730 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:38.587471 31739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.537140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:45883 (local address 127.23.39.253:34987)
0811 01:31:38.553436 (+ 16296us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:38.553444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:38.565408 (+ 11964us) server_negotiation.cc:407] Connection header received
0811 01:31:38.566605 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:38.566610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:38.566691 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:38.566807 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:38.568354 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.569568 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.571699 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.572237 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.572378 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.576347 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:38.576353 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:38.576357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:38.576401 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:38.580649 (+ 4248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.582187 (+ 1538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.582195 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.582198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.582363 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.582870 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.582874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.582877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.583292 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:38.583435 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:38.584524 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0811 01:31:38.584777 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15943,"thread_start_us":16131,"threads_started":1}
I20260811 01:31:38.587821 31729 heartbeater.cc:511] Master 127.23.39.252:44117 requested a full tablet report, sending...
I20260811 01:31:38.587852 31730 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:38.588546 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.536977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.23.39.193:45883)
0811 01:31:38.565269 (+ 28292us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:38.565288 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:38.566455 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:38.567020 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:38.567026 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:38.567741 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:38.568137 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.568154 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.569769 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.569775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.571509 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:38.571521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.572642 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.572651 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:38.572866 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.573504 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:38.573526 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:38.576077 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:38.580862 (+ 4785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.580869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.580873 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.582001 (+ 1128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.582529 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:38.582533 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:38.582536 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:38.582724 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:38.584025 (+ 1301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:38.584030 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:38.584192 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 01:31:38.587751 (+ 3559us) client_negotiation.cc:240] Negotiation successful
0811 01:31:38.588087 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28123,"thread_start_us":27948,"threads_started":1}
I20260811 01:31:38.589681 31731 heartbeater.cc:347] Connected to a master server at 127.23.39.253:34987
I20260811 01:31:38.589798 31731 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:38.590080 30609 ts_manager.cc:194] Re-registered known tserver with Master: 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643)
I20260811 01:31:38.590198 31731 heartbeater.cc:511] Master 127.23.39.253:34987 requested a full tablet report, sending...
I20260811 01:31:38.590699 31521 ts_manager.cc:194] Registered new tserver with Master: 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643)
I20260811 01:31:38.591230 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:52545
I20260811 01:31:38.591948 31303 ts_manager.cc:194] Registered new tserver with Master: 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643)
I20260811 01:31:38.592751 31737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:38.536337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36838 (local address 127.23.39.194:34559)
0811 01:31:38.562485 (+ 26148us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:38.562498 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:38.563729 (+ 1231us) server_negotiation.cc:407] Connection header received
0811 01:31:38.563860 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:38.563873 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:38.564169 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:38.564373 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:38.568833 (+ 4460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.570432 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.572836 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:38.573700 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:38.573837 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:38.582759 (+ 8922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:38.582784 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:38.582806 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:38.582855 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:38.587069 (+ 4214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.588160 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.588170 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.588173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.588381 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:38.588862 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:38.588867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:38.588870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:38.590343 (+ 1473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:38.590661 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:38.591952 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0811 01:31:38.592264 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25920,"thread_start_us":26171,"threads_started":1}
I20260811 01:31:38.594116 30980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:38.684105 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30836
I20260811 01:31:38.705267 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:34559
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:36077
--webserver_port=38147
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:31:38.726750 31470 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: NON_VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: true } } }
I20260811 01:31:38.727206 31470 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:38.729313 31470 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: attempting to promote NON_VOTER e43253350cb54f0bb531fac4a0d6105e to VOTER
I20260811 01:31:38.729938 31470 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } }
I20260811 01:31:38.731946 31314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 01:31:38.732100 31536 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 LEARNER]: Refusing update from remote peer e16e9c9d22ac47bea3828f9451b5cfc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260811 01:31:38.732647 31743 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 01:31:38.733098 31744 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 01:31:38.735857 31743 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e43253350cb54f0bb531fac4a0d6105e (127.23.39.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.736910 31314 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e43253350cb54f0bb531fac4a0d6105e (127.23.39.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.739979 31743 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.740316 31743 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:38.740653 31743 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.740857 31743 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:38.740535 31536 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e43253350cb54f0bb531fac4a0d6105e (127.23.39.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.742652 31748 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.743075 31748 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:38.739912 31470 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.747105 31470 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:38.747611 31569 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:38.747848 31569 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:31:39.077824 31742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:39.078258 31742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:39.078428 31742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:39.086359 31742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:39.086514 31742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:39.086688 31742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:39.097595 31742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:34559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=38147
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:39.099108 31742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:39.100453 31742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:39.115839 31753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:39.115816 31756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:39.115794 31754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:39.117151 31742 server_base.cc:1034] running on GCE node
I20260811 01:31:39.117885 31742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:39.119066 31742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:39.120321 31742 hybrid_clock.cc:648] HybridClock initialized: now 1786411899120264 us; error 50 us; skew 500 ppm
I20260811 01:31:39.120673 31742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:39.124137 31742 init.cc:377] Logged in from keytab as oryx/127.23.39.194@KRBTEST.COM (short username oryx)
I20260811 01:31:39.125655 31742 webserver.cc:460] Webserver started at http://127.23.39.194:38147/ using document root <none> and password file <none>
I20260811 01:31:39.126444 31742 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:39.126608 31742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:39.132681 31742 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:31:39.135723 31763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.137239 31742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:39.137445 31742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "d503ef7ee3084b03b24d53b6795b1b4b"
format_stamp: "Formatted at 2026-08-11 01:31:35 on dist-test-slave-9jjr"
server_key: "fabea6ed4098577e427b93034e9314b9"
server_key_iv: "163e53dffc492e90c14669da87715f69"
server_key_version: "encryptionkey@0"
I20260811 01:31:39.138650 31742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:39.153761 31742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:39.158816 31742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:39.159186 31742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:39.160306 31742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:39.161811 31742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:39.161939 31742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.162063 31742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:39.162194 31742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.198112 31742 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:34559
I20260811 01:31:39.198215 31894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:34559 every 8 connection(s)
I20260811 01:31:39.199887 31742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:39.206713 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 31742
I20260811 01:31:39.207116 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30992
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.195@KRBTEST.COM
I20260811 01:31:39.239990 31899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.203167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:34607 (local address 127.23.39.254:36077)
0811 01:31:39.204574 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.204585 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.205260 (+ 675us) server_negotiation.cc:407] Connection header received
0811 01:31:39.210328 (+ 5068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.210337 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.210468 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.210617 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.214051 (+ 3434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.215684 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.219533 (+ 3849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.220315 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.220462 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.228258 (+ 7796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.228268 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.228273 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.228324 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.232886 (+ 4562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.235238 (+ 2352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.235246 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.235250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.235509 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.237145 (+ 1636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.237154 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.237161 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.237638 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.237808 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.239218 (+ 1410us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.239586 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1217,"thread_start_us":1034,"threads_started":1}
I20260811 01:31:39.241358 31901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.203978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:34607)
0811 01:31:39.205041 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.205094 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.208418 (+ 3324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.211255 (+ 2837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.211274 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.212486 (+ 1212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.213690 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.213728 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.216037 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.216047 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.219234 (+ 3187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.219262 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.221051 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.221061 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.221561 (+ 500us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.223180 (+ 1619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.223217 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.227900 (+ 4683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.234295 (+ 6395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.234305 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.234328 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.235052 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.236189 (+ 1137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.236193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.236197 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.236640 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.238046 (+ 1406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.238056 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.238662 (+ 606us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.239076 (+ 414us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.239725 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":512,"threads_started":1}
I20260811 01:31:39.244920 31900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.203371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:47127 (local address 127.23.39.253:34987)
0811 01:31:39.204948 (+ 1577us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.204952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.205578 (+ 626us) server_negotiation.cc:407] Connection header received
0811 01:31:39.222606 (+ 17028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.222617 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.222769 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.223045 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.225218 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.226560 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.230291 (+ 3731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.231010 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.231153 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.236240 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.236249 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.236254 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.236313 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.240383 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.241586 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.241593 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.241598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.241820 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.242426 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.242434 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.242438 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.242908 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.243468 (+ 560us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.244211 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.244508 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1475,"thread_start_us":1374,"threads_started":1}
I20260811 01:31:39.246040 31902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.203978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.23.39.194:47127)
0811 01:31:39.205387 (+ 1409us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.205402 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.221924 (+ 16522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.223805 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.223810 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.224533 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.224963 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.224978 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.228129 (+ 3151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.228135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.230024 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.230041 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.231614 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.231620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.231819 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.232523 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.232557 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.235983 (+ 3426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.240616 (+ 4633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.240621 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.240624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.241369 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.242009 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.242015 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.242020 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.242273 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.243565 (+ 1292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.243571 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.243806 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.245147 (+ 1341us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.245525 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1262,"mutex_wait_us":422,"thread_start_us":1041,"threads_started":1}
I20260811 01:31:39.246158 31896 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:39.246588 31896 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.247224 31897 heartbeater.cc:347] Connected to a master server at 127.23.39.253:34987
I20260811 01:31:39.247387 31897 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.248061 31896 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:39.248072 31897 heartbeater.cc:511] Master 127.23.39.253:34987 requested a full tablet report, sending...
I20260811 01:31:39.250330 30609 ts_manager.cc:194] Re-registered known tserver with Master: d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:39.250828 31303 ts_manager.cc:194] Registered new tserver with Master: d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:39.251662 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:34607
I20260811 01:31:39.253171 31906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.208705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44832 (local address 127.23.39.195:38721)
0811 01:31:39.223139 (+ 14434us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.223149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.224052 (+ 903us) server_negotiation.cc:407] Connection header received
0811 01:31:39.224139 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.224148 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.224481 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.224759 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.227797 (+ 3038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.230171 (+ 2374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.232594 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.233628 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.233778 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.240780 (+ 7002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.240806 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.240829 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.240880 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.245782 (+ 4902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.248971 (+ 3189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.248984 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.248988 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.249211 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.249755 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.249760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.249764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.250384 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.250843 (+ 459us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.251973 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.252713 (+ 740us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14211,"thread_start_us":14528,"threads_started":1}
I20260811 01:31:39.255715 31133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:39.261513 31904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.206310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:58141 (local address 127.23.39.252:44117)
0811 01:31:39.228302 (+ 21992us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.228309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.228330 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:31:39.228399 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.228406 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.228493 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.228617 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.230521 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.231953 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.233886 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.234724 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.235738 (+ 1014us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.242932 (+ 7194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.242941 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.242945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.243054 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.253408 (+ 10354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.254610 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.254616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.254619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.254795 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.259241 (+ 4446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.259252 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.259259 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.259845 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.259998 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.260897 (+ 899us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.261191 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21781,"thread_start_us":21573,"threads_started":1}
I20260811 01:31:39.262471 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.205980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.23.39.194:58141)
0811 01:31:39.222697 (+ 16717us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.222721 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.222875 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.228736 (+ 5861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.228741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.229548 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.230080 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.230099 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.232178 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.232247 (+ 69us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.233657 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.233672 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.235124 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.235131 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.235375 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.236147 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.236173 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.242478 (+ 6305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.253575 (+ 11097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.253584 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.253592 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.254437 (+ 845us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.254962 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.254971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.254978 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.258932 (+ 3954us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.260148 (+ 1216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.260154 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.260504 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.261742 (+ 1238us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.262060 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16556,"thread_start_us":16388,"threads_started":1}
I20260811 01:31:39.263463 31895 heartbeater.cc:347] Connected to a master server at 127.23.39.252:44117
I20260811 01:31:39.263651 31895 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.264197 31895 heartbeater.cc:511] Master 127.23.39.252:44117 requested a full tablet report, sending...
I20260811 01:31:39.265484 31521 ts_manager.cc:194] Registered new tserver with Master: d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:39.346243 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30992
I20260811 01:31:39.367657 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:38721
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:36077
--webserver_port=45395
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:31:39.593822 31730 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
W20260811 01:31:39.754588 31909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:39.754899 31909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:39.754997 31909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:39.763460 31909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:39.763592 31909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:39.763715 31909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:39.774226 31909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:38721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=45395
--tserver_master_addrs=127.23.39.254:36077,127.23.39.253:34987,127.23.39.252:44117
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:39.775643 31909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:39.777025 31909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:39.791213 31920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:39.791311 31915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:39.791334 31917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:39.792184 31909 server_base.cc:1034] running on GCE node
I20260811 01:31:39.792855 31909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:39.793848 31909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:39.795071 31909 hybrid_clock.cc:648] HybridClock initialized: now 1786411899795018 us; error 45 us; skew 500 ppm
I20260811 01:31:39.795395 31909 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:39.798858 31909 init.cc:377] Logged in from keytab as oryx/127.23.39.195@KRBTEST.COM (short username oryx)
I20260811 01:31:39.800369 31909 webserver.cc:460] Webserver started at http://127.23.39.195:45395/ using document root <none> and password file <none>
I20260811 01:31:39.801054 31909 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:39.801178 31909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:39.807125 31909 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:31:39.810274 31928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.811899 31909 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:31:39.812107 31909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "a0e07fd71c214f51bc1a29509d50ccff"
format_stamp: "Formatted at 2026-08-11 01:31:36 on dist-test-slave-9jjr"
server_key: "41c4561e30de956ee890296673059e5d"
server_key_iv: "adbb01afe7da5c24d920a109c8523427"
server_key_version: "encryptionkey@0"
I20260811 01:31:39.813232 31909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:39.841725 31909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:39.847247 31909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:39.847883 31909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:39.849144 31909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:39.850936 31909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:39.851051 31909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.851193 31909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:39.851279 31909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:39.888396 31909 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:38721
I20260811 01:31:39.888496 32057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:38721 every 8 connection(s)
I20260811 01:31:39.890043 31909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:39.898602 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 31909
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.252@KRBTEST.COM
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
Aug 11 01:31:39 dist-test-slave-9jjr krb5kdc[30559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411899, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.253@KRBTEST.COM
I20260811 01:31:39.938470 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.893328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:41889 (local address 127.23.39.254:36077)
0811 01:31:39.915534 (+ 22206us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.915543 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.915568 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:39.915646 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.915654 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.915753 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.916139 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.920144 (+ 4005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.921609 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.924739 (+ 3130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.925673 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.925847 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.930340 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.930353 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.930357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.930398 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.934104 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.935171 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.935178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.935181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.935409 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.935965 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.935971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.935975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.936294 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.936458 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.937762 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.938021 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22014,"thread_start_us":22990,"threads_started":1}
I20260811 01:31:39.939663 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.894220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:41889)
0811 01:31:39.905010 (+ 10790us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.905074 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.908423 (+ 3349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.916639 (+ 8216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.916658 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.918218 (+ 1560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.919536 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.919574 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.921780 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.921786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.924464 (+ 2678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.924487 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.925905 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.925914 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.926119 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.926917 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.926940 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.930007 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.934319 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.934330 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.934351 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.935036 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.935533 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.935541 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.935544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.935822 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.936457 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.936467 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.936929 (+ 462us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.937279 (+ 350us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.938021 (+ 742us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10412,"mutex_wait_us":45,"thread_start_us":10100,"threads_started":1}
I20260811 01:31:39.941825 32059 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36077
I20260811 01:31:39.942214 32059 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.943310 32059 heartbeater.cc:511] Master 127.23.39.254:36077 requested a full tablet report, sending...
I20260811 01:31:39.945302 30609 ts_manager.cc:194] Re-registered known tserver with Master: a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:39.946537 30609 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:41889
I20260811 01:31:39.949630 32063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.893331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:57123 (local address 127.23.39.252:44117)
0811 01:31:39.914664 (+ 21333us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.914673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.914704 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:31:39.914793 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.914802 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.914905 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.918362 (+ 3457us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.920212 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.920983 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.923931 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.924429 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.924582 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.931745 (+ 7163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.931755 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.931763 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.931822 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.939034 (+ 7212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.941659 (+ 2625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.941669 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.941675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.941880 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.945102 (+ 3222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.945108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.945112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.945572 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.945757 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.946375 (+ 618us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.946679 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21155,"thread_start_us":21626,"threads_started":1}
I20260811 01:31:39.950704 32066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.894975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.23.39.195:57123)
0811 01:31:39.909465 (+ 14490us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.909488 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.909618 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.916636 (+ 7018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.916659 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.918223 (+ 1564us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.919852 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.919872 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.921242 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.921248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.923652 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.923673 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.924716 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.924725 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.924971 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.925743 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.925800 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.931432 (+ 5632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.940388 (+ 8956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.940396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.940402 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.941463 (+ 1061us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.942155 (+ 692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.942162 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.942169 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.944922 (+ 2753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.945861 (+ 939us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.945865 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.946042 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.949897 (+ 3855us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.950273 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14332,"mutex_wait_us":1075,"thread_start_us":14124,"threads_started":1}
I20260811 01:31:39.951922 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.909935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:48967 (local address 127.23.39.253:34987)
0811 01:31:39.922241 (+ 12306us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.922251 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.922278 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:31:39.922372 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.922380 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.922497 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.922650 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.926215 (+ 3565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.927756 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.930696 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.931518 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.931690 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.940456 (+ 8766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.940463 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.940468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.940518 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.947726 (+ 7208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.948778 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.948784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.948787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.948990 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.949472 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.949480 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.949483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.950319 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.950471 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.951201 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.951483 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12084,"thread_start_us":11951,"threads_started":1}
I20260811 01:31:39.951953 32058 heartbeater.cc:347] Connected to a master server at 127.23.39.252:44117
I20260811 01:31:39.952103 32058 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.952546 32058 heartbeater.cc:511] Master 127.23.39.252:44117 requested a full tablet report, sending...
I20260811 01:31:39.952773 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.913658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.23.39.195:48967)
0811 01:31:39.914581 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:39.914616 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:39.914842 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:39.922678 (+ 7836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:39.922684 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:39.923441 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:39.923880 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.923894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.928573 (+ 4679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.928582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.930358 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:39.930380 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.932939 (+ 2559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.932950 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:39.933246 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.934996 (+ 1750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:39.935029 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:39.940164 (+ 5135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:39.947881 (+ 7717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.947889 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.947894 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.948591 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.949097 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:39.949106 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:39.949113 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:39.949325 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:39.950458 (+ 1133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:39.950466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:39.950678 (+ 212us) client_negotiation.cc:769] Sending connection context
0811 01:31:39.951053 (+ 375us) client_negotiation.cc:240] Negotiation successful
0811 01:31:39.952145 (+ 1092us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":1200,"threads_started":1}
I20260811 01:31:39.953977 31521 ts_manager.cc:194] Registered new tserver with Master: a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:39.954347 32060 heartbeater.cc:347] Connected to a master server at 127.23.39.253:34987
I20260811 01:31:39.954504 32060 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:39.954886 32060 heartbeater.cc:511] Master 127.23.39.253:34987 requested a full tablet report, sending...
I20260811 01:31:39.956029 31303 ts_manager.cc:194] Registered new tserver with Master: a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:39.982930 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.931193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40422 (local address 127.23.39.254:36077)
0811 01:31:39.938840 (+ 7647us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.938846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.962889 (+ 24043us) server_negotiation.cc:407] Connection header received
0811 01:31:39.963148 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.963157 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.963295 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.963414 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.967189 (+ 3775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.968517 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.970905 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.971396 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.972003 (+ 607us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.975786 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.975792 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.975795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.975833 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.979253 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.980214 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.980221 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.980225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.980439 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.980888 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.980894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.980898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.981383 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.981716 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.982207 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.982513 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7537,"thread_start_us":32403,"threads_started":1}
I20260811 01:31:39.983541 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.942989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45470 (local address 127.23.39.253:34987)
0811 01:31:39.952193 (+ 9204us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.952199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.964054 (+ 11855us) server_negotiation.cc:407] Connection header received
0811 01:31:39.964147 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.964155 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.964257 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.964367 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.967390 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.968407 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.970097 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.970600 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.970775 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.975217 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.975225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.975239 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.975291 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.979402 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.980425 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.980431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.980434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.980621 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.981143 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.981149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.981153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.981623 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.981891 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.982819 (+ 928us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.983142 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9082,"thread_start_us":23352,"threads_started":1}
I20260811 01:31:39.986398 32063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:39.963208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.23.39.252:44117)
0811 01:31:39.963447 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:39.963453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:39.967243 (+ 3790us) server_negotiation.cc:407] Connection header received
0811 01:31:39.967488 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:39.967497 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:39.967626 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:39.967751 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:39.970563 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.971648 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.973502 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:39.973992 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:39.974181 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:39.978175 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:39.978186 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:39.978192 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:39.978242 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:39.982081 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.982953 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.982960 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.982963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.983162 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:39.983587 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:39.983592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:39.983595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:39.984043 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:39.984366 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:39.985846 (+ 1480us) server_negotiation.cc:299] Negotiation successful
0811 01:31:39.986042 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 01:31:39.988512 30609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:39.995893 30609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:40.047847 32095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.018783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34559 (local address 127.0.0.1:36850)
0811 01:31:40.031758 (+ 12975us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:40.031788 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:40.033266 (+ 1478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:40.038561 (+ 5295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:40.038567 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:40.038606 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:40.039227 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.039253 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.042255 (+ 3002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.042261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.044193 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.044208 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.046944 (+ 2736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.046950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.047165 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.047210 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:31:40.047318 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 01:31:40.047478 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12753,"thread_start_us":20305,"threads_started":1}
I20260811 01:31:40.048192 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.019017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36850 (local address 127.23.39.194:34559)
0811 01:31:40.037160 (+ 18143us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.037174 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.037223 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:31:40.037381 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.037394 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.037802 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.038581 (+ 779us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:40.039486 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.040843 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.044389 (+ 3546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.046204 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.046350 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.046886 (+ 536us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.047683 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.047887 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17857,"thread_start_us":19133,"threads_started":1}
I20260811 01:31:40.049582 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.019487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.23.39.193:33643)
0811 01:31:40.030654 (+ 11167us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.030679 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.039781 (+ 9102us) server_negotiation.cc:407] Connection header received
0811 01:31:40.039995 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.040007 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.040354 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.040620 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:40.041530 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.043985 (+ 2455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.046015 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.048043 (+ 2028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.048202 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.048458 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.049081 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.049306 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9708,"thread_start_us":9540,"threads_started":1}
I20260811 01:31:40.049669 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.019206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33643 (local address 127.0.0.1:51230)
0811 01:31:40.039400 (+ 20194us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:40.039423 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:40.039807 (+ 384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:40.040625 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:40.040630 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:40.040675 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:40.041120 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.041131 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.044181 (+ 3050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.044186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.045812 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.045830 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.048607 (+ 2777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.048615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.048848 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.048883 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:31:40.048992 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:31:40.049171 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20050,"thread_start_us":26632,"threads_started":1}
I20260811 01:31:40.052469 31822 tablet_service.cc:1467] Processing CreateTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 (DEFAULT_TABLE table=test-table [id=6c5520be68294678b37f3ca673d1b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:40.053787 31822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b5b16fce064abaa4581d7eeca6a462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:40.053697 31655 tablet_service.cc:1467] Processing CreateTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 (DEFAULT_TABLE table=test-table [id=6c5520be68294678b37f3ca673d1b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:40.055217 31655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b5b16fce064abaa4581d7eeca6a462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:40.058954 32093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.019718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:38721 (local address 127.0.0.1:44834)
0811 01:31:40.045526 (+ 25808us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:40.045549 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:40.045722 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:40.046592 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:40.046597 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:40.046632 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:40.047285 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.047299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.051595 (+ 4296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.051604 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.054762 (+ 3158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.054787 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.057795 (+ 3008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.057803 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.058023 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.058064 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:31:40.058249 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 01:31:40.058431 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25629,"thread_start_us":12313,"threads_started":1}
I20260811 01:31:40.059087 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.020006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44834 (local address 127.23.39.195:38721)
0811 01:31:40.044736 (+ 24730us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.044746 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.045691 (+ 945us) server_negotiation.cc:407] Connection header received
0811 01:31:40.045920 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.045931 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.046298 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.046522 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:40.048495 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.051425 (+ 2930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.054987 (+ 3562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.056700 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.056850 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.057059 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.058524 (+ 1465us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.058722 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24494,"thread_start_us":24738,"threads_started":1}
I20260811 01:31:40.064795 31985 tablet_service.cc:1467] Processing CreateTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 (DEFAULT_TABLE table=test-table [id=6c5520be68294678b37f3ca673d1b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:40.066819 31985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4b5b16fce064abaa4581d7eeca6a462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:40.068600 32097 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Bootstrap starting.
I20260811 01:31:40.072223 32097 tablet_bootstrap.cc:654] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:40.073251 32098 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Bootstrap starting.
I20260811 01:31:40.074854 32097 log.cc:824] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:40.077287 32098 tablet_bootstrap.cc:654] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:40.078575 32097 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: No bootstrap required, opened a new log
I20260811 01:31:40.078773 32098 log.cc:824] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:40.078893 32097 ts_tablet_manager.cc:1397] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:31:40.082319 32098 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: No bootstrap required, opened a new log
I20260811 01:31:40.082638 32098 ts_tablet_manager.cc:1397] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:31:40.084649 32101 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Bootstrap starting.
I20260811 01:31:40.089286 32101 tablet_bootstrap.cc:654] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:40.090648 32101 log.cc:824] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:40.090337 32097 raft_consensus.cc:348] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.090863 32097 raft_consensus.cc:374] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:40.090976 32097 raft_consensus.cc:729] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d503ef7ee3084b03b24d53b6795b1b4b, State: Initialized, Role: FOLLOWER
I20260811 01:31:40.091703 32097 consensus_queue.cc:260] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.093161 31896 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
I20260811 01:31:40.094328 32098 raft_consensus.cc:348] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.094844 32098 raft_consensus.cc:374] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:40.094954 32098 raft_consensus.cc:729] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86163ec230ce4d78b4020696079083d2, State: Initialized, Role: FOLLOWER
I20260811 01:31:40.095774 32098 consensus_queue.cc:260] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.101336 32101 tablet_bootstrap.cc:492] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: No bootstrap required, opened a new log
I20260811 01:31:40.101665 32101 ts_tablet_manager.cc:1397] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260811 01:31:40.102041 32098 ts_tablet_manager.cc:1428] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Time spent starting tablet: real 0.019s user 0.014s sys 0.004s
I20260811 01:31:40.112422 32097 ts_tablet_manager.cc:1428] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Time spent starting tablet: real 0.033s user 0.015s sys 0.000s
I20260811 01:31:40.112499 32101 raft_consensus.cc:348] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.113083 32101 raft_consensus.cc:374] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:40.113209 32101 raft_consensus.cc:729] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e07fd71c214f51bc1a29509d50ccff, State: Initialized, Role: FOLLOWER
I20260811 01:31:40.113992 32101 consensus_queue.cc:260] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.116215 32101 ts_tablet_manager.cc:1428] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260811 01:31:40.116505 32059 heartbeater.cc:503] Master 127.23.39.254:36077 was elected leader, sending a full tablet report...
W20260811 01:31:40.169953 32061 tablet.cc:2369] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:31:40.203708 31898 tablet.cc:2369] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:31:40.318069 31740 tablet.cc:2369] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:31:40.373760 32104 raft_consensus.cc:482] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:40.374228 32104 raft_consensus.cc:504] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.376196 32104 leader_election.cc:288] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643), a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:40.384042 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.376945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:36357 (local address 127.23.39.195:38721)
0811 01:31:40.377190 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.377199 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.378147 (+ 948us) server_negotiation.cc:407] Connection header received
0811 01:31:40.378407 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.378411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.378474 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.378569 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:40.379186 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.379973 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.382019 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.382908 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.383121 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.383221 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.383591 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.383747 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:31:40.384039 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.376805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:46123 (local address 127.23.39.193:33643)
0811 01:31:40.377083 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.377093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.378328 (+ 1235us) server_negotiation.cc:407] Connection header received
0811 01:31:40.378555 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.378559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.378618 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.378711 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:40.379365 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.380093 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.382027 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.382935 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.383134 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.383226 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.383589 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.383741 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 01:31:40.384225 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.376489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:38721 (local address 127.23.39.194:36357)
0811 01:31:40.377984 (+ 1495us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:40.378002 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:40.378239 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:40.378586 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:40.378590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:40.378614 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:40.379011 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.379021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.380130 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.380135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.381848 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.381863 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.383180 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.383187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.383382 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.383455 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 01:31:40.383560 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:31:40.383754 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340,"mutex_wait_us":67,"thread_start_us":1231,"threads_started":1}
I20260811 01:31:40.384624 32107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.376658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33643 (local address 127.23.39.194:46123)
0811 01:31:40.378031 (+ 1373us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:40.378046 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:40.378409 (+ 363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:40.378732 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:40.378736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:40.378764 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:40.379212 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.379222 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.380231 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.380237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.381849 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:40.381863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.383226 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.383233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:40.383384 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.383452 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 01:31:40.383560 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 01:31:40.383756 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"mutex_wait_us":103,"thread_start_us":651,"threads_started":1}
I20260811 01:31:40.385443 32009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b5b16fce064abaa4581d7eeca6a462" candidate_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e07fd71c214f51bc1a29509d50ccff" is_pre_election: true
I20260811 01:31:40.385766 31676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b5b16fce064abaa4581d7eeca6a462" candidate_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86163ec230ce4d78b4020696079083d2" is_pre_election: true
I20260811 01:31:40.386175 32009 raft_consensus.cc:2454] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d503ef7ee3084b03b24d53b6795b1b4b in term 0.
I20260811 01:31:40.386348 31676 raft_consensus.cc:2454] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d503ef7ee3084b03b24d53b6795b1b4b in term 0.
I20260811 01:31:40.387159 31765 leader_election.cc:302] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 86163ec230ce4d78b4020696079083d2, a0e07fd71c214f51bc1a29509d50ccff, d503ef7ee3084b03b24d53b6795b1b4b; no voters:
I20260811 01:31:40.387624 32104 raft_consensus.cc:2781] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:40.387784 32104 raft_consensus.cc:482] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:40.387908 32104 raft_consensus.cc:3037] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:40.390483 32104 raft_consensus.cc:504] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.391217 32104 leader_election.cc:288] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [CANDIDATE]: Term 1 election: Requested vote from peers 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643), a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721)
I20260811 01:31:40.391773 31676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b5b16fce064abaa4581d7eeca6a462" candidate_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86163ec230ce4d78b4020696079083d2"
I20260811 01:31:40.391865 32009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4b5b16fce064abaa4581d7eeca6a462" candidate_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e07fd71c214f51bc1a29509d50ccff"
I20260811 01:31:40.392006 31676 raft_consensus.cc:3037] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:40.392122 32009 raft_consensus.cc:3037] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:40.394558 32009 raft_consensus.cc:2454] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d503ef7ee3084b03b24d53b6795b1b4b in term 1.
I20260811 01:31:40.394567 31676 raft_consensus.cc:2454] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d503ef7ee3084b03b24d53b6795b1b4b in term 1.
I20260811 01:31:40.395074 31765 leader_election.cc:302] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0e07fd71c214f51bc1a29509d50ccff, d503ef7ee3084b03b24d53b6795b1b4b; no voters:
I20260811 01:31:40.395428 32104 raft_consensus.cc:2781] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:40.395984 32104 raft_consensus.cc:686] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 1 LEADER]: Becoming Leader. State: Replica: d503ef7ee3084b03b24d53b6795b1b4b, State: Running, Role: LEADER
I20260811 01:31:40.396590 32104 consensus_queue.cc:237] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } }
I20260811 01:31:40.401582 30607 catalog_manager.cc:5495] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b reported cstate change: term changed from 0 to 1, leader changed from <none> to d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194). New cstate: current_term: 1 leader_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } health_report { overall_health: UNKNOWN } } }
I20260811 01:31:40.504838 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.499002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.23.39.194:34559)
0811 01:31:40.499231 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.499239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.499539 (+ 300us) server_negotiation.cc:407] Connection header received
0811 01:31:40.499728 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.499732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.499833 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.499966 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:40.500405 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.501097 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.502533 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.502961 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.503078 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.503608 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:40.504180 (+ 572us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:40.504319 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.504424 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.504502 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 01:31:40.515079 32009 raft_consensus.cc:1261] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Refusing update from remote peer d503ef7ee3084b03b24d53b6795b1b4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:40.515080 31676 raft_consensus.cc:1261] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Refusing update from remote peer d503ef7ee3084b03b24d53b6795b1b4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:40.516163 32109 consensus_queue.cc:1035] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:40.516610 32104 consensus_queue.cc:1035] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:40.552132 32115 mvcc.cc:205] Tried to move back new op lower bound from 7317143144497889280 to 7317143144028291072. Current Snapshot: MvccSnapshot[applied={T|T < 7317143144497889280}]
I20260811 01:31:40.575265 30607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:40.575624 30607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:40.583986 30607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e16e9c9d22ac47bea3828f9451b5cfc0: Sending DeleteTablet for 3 replicas of tablet b4b5b16fce064abaa4581d7eeca6a462
I20260811 01:31:40.585393 31655 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:40 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51230
I20260811 01:31:40.585410 31985 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:40 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:44834
I20260811 01:31:40.585467 31822 tablet_service.cc:1514] Processing DeleteTablet for tablet b4b5b16fce064abaa4581d7eeca6a462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:40 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:36850
I20260811 01:31:40.609052 32126 tablet_replica.cc:330] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: stopping tablet replica
I20260811 01:31:40.609629 32126 raft_consensus.cc:2229] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:40.610311 32126 raft_consensus.cc:2258] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:40.612849 32126 ts_tablet_manager.cc:1905] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:40.620920 32126 ts_tablet_manager.cc:1918] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:40.621168 32126 log.cc:1196] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/b4b5b16fce064abaa4581d7eeca6a462
I20260811 01:31:40.621851 32126 ts_tablet_manager.cc:1939] T b4b5b16fce064abaa4581d7eeca6a462 P a0e07fd71c214f51bc1a29509d50ccff: Deleting consensus metadata
I20260811 01:31:40.622840 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 30573
I20260811 01:31:40.624356 30590 catalog_manager.cc:4841] TS a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721): tablet b4b5b16fce064abaa4581d7eeca6a462 (table test-table [id=6c5520be68294678b37f3ca673d1b67e]) successfully deleted
I20260811 01:31:40.625037 30643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:40.631287 32128 tablet_replica.cc:330] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: stopping tablet replica
I20260811 01:31:40.632233 32125 tablet_replica.cc:330] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: stopping tablet replica
I20260811 01:31:40.632686 32125 raft_consensus.cc:2229] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:40.633229 32125 raft_consensus.cc:2258] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:40.633773 32128 raft_consensus.cc:2229] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:40.634626 32128 raft_consensus.cc:2258] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:40.637243 32125 ts_tablet_manager.cc:1905] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:40.644132 32128 ts_tablet_manager.cc:1905] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:40.653059 32128 ts_tablet_manager.cc:1918] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:40.653319 32128 log.cc:1196] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/b4b5b16fce064abaa4581d7eeca6a462
I20260811 01:31:40.654080 32128 ts_tablet_manager.cc:1939] T b4b5b16fce064abaa4581d7eeca6a462 P d503ef7ee3084b03b24d53b6795b1b4b: Deleting consensus metadata
I20260811 01:31:40.656816 32130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.589572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.23.39.253:34987)
0811 01:31:40.608366 (+ 18794us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.608377 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.612768 (+ 4391us) server_negotiation.cc:407] Connection header received
0811 01:31:40.624403 (+ 11635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.624412 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.624517 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.624609 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:40.627691 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.629026 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.642373 (+ 13347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.643216 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.643362 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.647913 (+ 4551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:40.647922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:40.647928 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:40.647987 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:40.652693 (+ 4706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.653984 (+ 1291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.653991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.653995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.654204 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.654720 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.654726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.654729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.655163 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:40.655420 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.656065 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.656347 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18540,"thread_start_us":18812,"threads_started":1}
I20260811 01:31:40.665966 32125 ts_tablet_manager.cc:1918] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:40.666244 32125 log.cc:1196] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/b4b5b16fce064abaa4581d7eeca6a462
I20260811 01:31:40.666941 32125 ts_tablet_manager.cc:1939] T b4b5b16fce064abaa4581d7eeca6a462 P 86163ec230ce4d78b4020696079083d2: Deleting consensus metadata
I20260811 01:31:40.685315 32131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.614310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37534 (local address 127.23.39.252:44117)
0811 01:31:40.627555 (+ 13245us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.627562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.659564 (+ 32002us) server_negotiation.cc:407] Connection header received
0811 01:31:40.660646 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.660653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.660750 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.660896 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:40.669082 (+ 8186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.670456 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.672708 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.673465 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.673621 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.677401 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:40.677410 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:40.677415 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:40.677472 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:40.681695 (+ 4223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.682923 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.682930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.682934 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.683140 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.683607 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.683612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.683615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.684010 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:40.684291 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.684644 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.684893 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13081,"thread_start_us":14102,"threads_started":1}
I20260811 01:31:40.773947 30591 catalog_manager.cc:4841] TS d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559): tablet b4b5b16fce064abaa4581d7eeca6a462 (table test-table [id=6c5520be68294678b37f3ca673d1b67e]) successfully deleted
I20260811 01:31:40.774238 30593 catalog_manager.cc:4841] TS 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643): tablet b4b5b16fce064abaa4581d7eeca6a462 (table test-table [id=6c5520be68294678b37f3ca673d1b67e]) successfully deleted
I20260811 01:31:40.774806 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 30573
I20260811 01:31:40.833892 32130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.815121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45480 (local address 127.23.39.253:34987)
0811 01:31:40.815414 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.815424 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.816517 (+ 1093us) server_negotiation.cc:407] Connection header received
0811 01:31:40.816871 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.816876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.816975 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.817079 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:40.819407 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.820305 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.822305 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.822883 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.823042 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.827130 (+ 4088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:40.827137 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:40.827142 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:40.827188 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:40.830855 (+ 3667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.831615 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.831621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.831625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.831822 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.832318 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.832323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.832326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.832703 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:40.832988 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.833347 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.833573 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:31:40.836467 32131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:40.816881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.23.39.252:44117)
0811 01:31:40.817105 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:40.817135 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:40.817460 (+ 325us) server_negotiation.cc:407] Connection header received
0811 01:31:40.817811 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:40.817817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:40.817929 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:40.818037 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:40.820112 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.820952 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.822439 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:40.823142 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:40.823266 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:40.827959 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:40.827966 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:40.827971 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:40.828015 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:40.831671 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.832635 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.832640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.832644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.832811 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:40.833259 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:40.833264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:40.833268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:40.833824 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:40.835711 (+ 1887us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:40.835878 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 01:31:40.836117 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:31:41.551082 32142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:41.550332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:37519)
0811 01:31:41.550767 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:41.550903 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":218,"threads_started":1}
W20260811 01:31:41.551592 31730 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:36077 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:41.562933 32143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:41.561976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:59441)
0811 01:31:41.562530 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:41.562680 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":344,"threads_started":1}
W20260811 01:31:41.563398 31896 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:36077 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:41.563776 32144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:41.562915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:37087)
0811 01:31:41.563384 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:41.563536 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":353,"threads_started":1}
W20260811 01:31:41.564294 32059 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:36077 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.082849 32145 raft_consensus.cc:482] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e16e9c9d22ac47bea3828f9451b5cfc0)
I20260811 01:31:42.083138 32145 raft_consensus.cc:504] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } }
I20260811 01:31:42.084112 32146 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e16e9c9d22ac47bea3828f9451b5cfc0)
I20260811 01:31:42.084265 32145 leader_election.cc:288] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077), aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253:34987)
I20260811 01:31:42.084455 32146 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } }
I20260811 01:31:42.086416 32146 leader_election.cc:288] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077), e43253350cb54f0bb531fac4a0d6105e (127.23.39.252:44117)
I20260811 01:31:42.088284 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.086584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40844)
0811 01:31:42.087555 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.087762 (+ 207us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":865,"threads_started":1}
W20260811 01:31:42.088634 31283 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.101907 32153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.101207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40848)
0811 01:31:42.101474 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.101677 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260811 01:31:42.102222 31283 leader_election.cc:334] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077): Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.104971 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.084523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40838)
0811 01:31:42.104219 (+ 19696us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.104505 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19505,"mutex_wait_us":65,"thread_start_us":18384,"threads_started":1}
W20260811 01:31:42.105926 31503 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.111642 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.084522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:34987 (local address 127.0.0.1:45494)
0811 01:31:42.103292 (+ 18770us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.103319 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.103518 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.104170 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.104176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.104209 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.104542 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.104554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.106209 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.106215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.108539 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.108554 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.110681 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.110688 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.110911 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.110949 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.111076 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.111241 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18644,"thread_start_us":20560,"threads_started":1}
I20260811 01:31:42.111685 32151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.084934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45494 (local address 127.23.39.253:34987)
0811 01:31:42.087096 (+ 2162us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.087106 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.103469 (+ 16363us) server_negotiation.cc:407] Connection header received
0811 01:31:42.103728 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.103734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.103822 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.103928 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.104768 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.105994 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.108765 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.110194 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.110373 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.110673 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.111141 (+ 468us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.111267 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2014,"thread_start_us":1815,"threads_started":1}
I20260811 01:31:42.112373 31314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e43253350cb54f0bb531fac4a0d6105e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa83e547dda042a6bd7eeb88e17e8606" is_pre_election: true
I20260811 01:31:42.112702 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.112247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40852)
0811 01:31:42.112418 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.112540 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 01:31:42.112757 31314 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43253350cb54f0bb531fac4a0d6105e in term 1.
W20260811 01:31:42.113022 31503 leader_election.cc:334] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077): Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.113379 31504 leader_election.cc:302] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa83e547dda042a6bd7eeb88e17e8606, e43253350cb54f0bb531fac4a0d6105e; no voters: e16e9c9d22ac47bea3828f9451b5cfc0
I20260811 01:31:42.113749 32145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 01:31:42.113924 32145 raft_consensus.cc:482] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e16e9c9d22ac47bea3828f9451b5cfc0)
I20260811 01:31:42.114049 32145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:31:42.114897 32155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.103333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.23.39.252:44117)
0811 01:31:42.105964 (+ 2631us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.105970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.105992 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:31:42.106058 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.106062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.106172 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.106925 (+ 753us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.107291 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.109300 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.112431 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.113834 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.113983 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.114167 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.114494 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.114615 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":2479,"thread_start_us":2293,"threads_started":1}
I20260811 01:31:42.114910 32152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.087080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44117 (local address 127.0.0.1:37562)
0811 01:31:42.088555 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.088581 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.088822 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.106363 (+ 17541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.106369 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.106401 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.106759 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.106772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.109559 (+ 2787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.109568 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.112267 (+ 2699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.112287 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.114030 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.114040 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.114278 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.114320 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.114434 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.114611 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"thread_start_us":12014,"threads_started":1}
I20260811 01:31:42.115813 31536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa83e547dda042a6bd7eeb88e17e8606" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e43253350cb54f0bb531fac4a0d6105e" is_pre_election: true
I20260811 01:31:42.117105 32145 raft_consensus.cc:504] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } }
I20260811 01:31:42.117627 31536 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa83e547dda042a6bd7eeb88e17e8606 in current term 2: Already voted for candidate e43253350cb54f0bb531fac4a0d6105e in this term.
I20260811 01:31:42.117873 32145 leader_election.cc:288] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 election: Requested vote from peers e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077), aa83e547dda042a6bd7eeb88e17e8606 (127.23.39.253:34987)
I20260811 01:31:42.118498 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.118025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40854)
0811 01:31:42.118192 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.118300 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 01:31:42.118786 31284 leader_election.cc:302] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa83e547dda042a6bd7eeb88e17e8606; no voters: e16e9c9d22ac47bea3828f9451b5cfc0, e43253350cb54f0bb531fac4a0d6105e
I20260811 01:31:42.119242 32146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:31:42.119524 31314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e43253350cb54f0bb531fac4a0d6105e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa83e547dda042a6bd7eeb88e17e8606"
I20260811 01:31:42.119652 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.119246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40870)
0811 01:31:42.119428 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.119524 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 01:31:42.119843 31503 leader_election.cc:334] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077): Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
I20260811 01:31:42.121666 32146 raft_consensus.cc:2726] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:31:42.124414 31314 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43253350cb54f0bb531fac4a0d6105e in term 2.
I20260811 01:31:42.125373 31504 leader_election.cc:302] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa83e547dda042a6bd7eeb88e17e8606, e43253350cb54f0bb531fac4a0d6105e; no voters: e16e9c9d22ac47bea3828f9451b5cfc0
I20260811 01:31:42.125770 32145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:31:42.126314 32145 raft_consensus.cc:686] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [term 2 LEADER]: Becoming Leader. State: Replica: e43253350cb54f0bb531fac4a0d6105e, State: Running, Role: LEADER
I20260811 01:31:42.126719 32145 consensus_queue.cc:237] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } }
I20260811 01:31:42.128403 32157 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e43253350cb54f0bb531fac4a0d6105e. Latest consensus state: current_term: 2 leader_uuid: "e43253350cb54f0bb531fac4a0d6105e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:42.128868 32157 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:42.129694 32159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:42.133724 32159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:42.134768 32159 catalog_manager.cc:1259] Loaded cluster ID: 443b9196818c4da5a418f427eb274cd5
I20260811 01:31:42.134846 32159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:42.136162 32159 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:42.137017 32159 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Loaded TSK: 0
I20260811 01:31:42.137907 32159 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:31:42.180186 31520 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:42.187527 31520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:42.192224 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.191690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40908)
0811 01:31:42.191912 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.192021 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 01:31:42.192265 31314 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [term 2 FOLLOWER]: Refusing update from remote peer e43253350cb54f0bb531fac4a0d6105e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 01:31:42.193192 32157 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 01:31:42.193365 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.192976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40918)
0811 01:31:42.193152 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.193232 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 01:31:42.193706 31503 consensus_peers.cc:487] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e -> Peer e16e9c9d22ac47bea3828f9451b5cfc0 (127.23.39.254:36077): Couldn't send request to peer e16e9c9d22ac47bea3828f9451b5cfc0. Status: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 01:31:42.196372 32146 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e43253350cb54f0bb531fac4a0d6105e. Latest consensus state: current_term: 2 leader_uuid: "e43253350cb54f0bb531fac4a0d6105e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:42.196754 32146 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:42.198518 32145 sys_catalog.cc:455] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "e43253350cb54f0bb531fac4a0d6105e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:42.198871 32145 sys_catalog.cc:458] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:42.200404 32146 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "e43253350cb54f0bb531fac4a0d6105e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "e16e9c9d22ac47bea3828f9451b5cfc0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36077 } } peers { permanent_uuid: "aa83e547dda042a6bd7eeb88e17e8606" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 34987 } attrs { promote: false } } peers { permanent_uuid: "e43253350cb54f0bb531fac4a0d6105e" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44117 } attrs { promote: false } } }
I20260811 01:31:42.200795 32146 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa83e547dda042a6bd7eeb88e17e8606 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:31:42.227526 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.210015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:38721 (local address 127.0.0.1:44850)
0811 01:31:42.210361 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.210379 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.210512 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.220164 (+ 9652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.220174 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.220219 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.220729 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.220749 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.222940 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.222949 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.224919 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.224934 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.226665 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.226675 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.226889 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.226916 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.227038 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.227200 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":1}
I20260811 01:31:42.227512 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.210812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44850 (local address 127.23.39.195:38721)
0811 01:31:42.219605 (+ 8793us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.219616 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.219648 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:31:42.219761 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.219767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.219882 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.220948 (+ 1066us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.221200 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.222713 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.225144 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.226425 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.226582 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.226711 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.227070 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.227225 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8622,"thread_start_us":8501,"threads_started":1}
I20260811 01:31:42.228762 31985 tablet_service.cc:1467] Processing CreateTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c (DEFAULT_TABLE table=test-table [id=e41b5631fcf34f91a3142b924663a564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:42.229359 31985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afccb5a0a9a24a48bbf2e02c301a182c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:42.230032 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.209246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33643 (local address 127.0.0.1:51242)
0811 01:31:42.209534 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.209557 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.209694 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.223810 (+ 14116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.223821 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.223855 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.224032 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.224044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.225506 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.225512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.227443 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.227459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.229209 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.229216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.229394 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.229432 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.229502 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.229649 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":61}
I20260811 01:31:42.230863 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.209390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.23.39.193:33643)
0811 01:31:42.223371 (+ 13981us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.223381 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.223408 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:31:42.223504 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.223512 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.223621 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.223755 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.224228 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.225358 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.227658 (+ 2300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.229017 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.230297 (+ 1280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.230426 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.230486 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.230599 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13792,"thread_start_us":13653,"threads_started":1}
I20260811 01:31:42.231622 31655 tablet_service.cc:1467] Processing CreateTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c (DEFAULT_TABLE table=test-table [id=e41b5631fcf34f91a3142b924663a564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:42.232087 31655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afccb5a0a9a24a48bbf2e02c301a182c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:42.233074 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.210015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34559 (local address 127.0.0.1:36866)
0811 01:31:42.224832 (+ 14817us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.224856 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.224991 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.226110 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.226115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.226169 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.226628 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.226644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.228060 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.228065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.230309 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.230325 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.232151 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.232158 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.232345 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.232381 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.232502 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.232675 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14650,"mutex_wait_us":991,"thread_start_us":14019,"threads_started":1}
I20260811 01:31:42.233827 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.210291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.23.39.194:34559)
0811 01:31:42.219426 (+ 9135us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.219438 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.225766 (+ 6328us) server_negotiation.cc:407] Connection header received
0811 01:31:42.225861 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.225867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.225961 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.226076 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.226849 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.227896 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.230495 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.231908 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.232057 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.232168 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.233325 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.233502 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8925,"thread_start_us":8756,"threads_started":1}
I20260811 01:31:42.236613 32172 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Bootstrap starting.
I20260811 01:31:42.238323 32172 tablet_bootstrap.cc:654] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:42.238507 32173 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Bootstrap starting.
I20260811 01:31:42.239037 31822 tablet_service.cc:1467] Processing CreateTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c (DEFAULT_TABLE table=test-table [id=e41b5631fcf34f91a3142b924663a564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:42.239560 31822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afccb5a0a9a24a48bbf2e02c301a182c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:42.240466 32173 tablet_bootstrap.cc:654] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:42.242862 32173 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: No bootstrap required, opened a new log
I20260811 01:31:42.243117 32173 ts_tablet_manager.cc:1397] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260811 01:31:42.244006 32173 raft_consensus.cc:348] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.244299 32173 raft_consensus.cc:374] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:42.244397 32173 raft_consensus.cc:729] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86163ec230ce4d78b4020696079083d2, State: Initialized, Role: FOLLOWER
I20260811 01:31:42.244658 32173 consensus_queue.cc:260] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.245199 32172 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: No bootstrap required, opened a new log
I20260811 01:31:42.245744 32173 ts_tablet_manager.cc:1428] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:31:42.245370 32172 ts_tablet_manager.cc:1397] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260811 01:31:42.246989 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.245923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:55887)
0811 01:31:42.246534 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.246715 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":290,"threads_started":1}
I20260811 01:31:42.248179 32172 raft_consensus.cc:348] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.248461 32172 raft_consensus.cc:374] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:42.248561 32172 raft_consensus.cc:729] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e07fd71c214f51bc1a29509d50ccff, State: Initialized, Role: FOLLOWER
I20260811 01:31:42.248834 32172 consensus_queue.cc:260] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.249380 31729 heartbeater.cc:503] Master 127.23.39.252:44117 was elected leader, sending a full tablet report...
I20260811 01:31:42.249789 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.247609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:39427)
0811 01:31:42.248190 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.249153 (+ 963us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":321,"threads_started":1}
I20260811 01:31:42.252278 32172 ts_tablet_manager.cc:1428] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260811 01:31:42.253413 32179 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Bootstrap starting.
I20260811 01:31:42.255080 32058 heartbeater.cc:503] Master 127.23.39.252:44117 was elected leader, sending a full tablet report...
I20260811 01:31:42.255505 32179 tablet_bootstrap.cc:654] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:42.258675 32179 tablet_bootstrap.cc:492] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: No bootstrap required, opened a new log
I20260811 01:31:42.258859 32179 ts_tablet_manager.cc:1397] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 01:31:42.259191 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.252904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:45477)
0811 01:31:42.258674 (+ 5770us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.258893 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5639,"thread_start_us":5467,"threads_started":1}
I20260811 01:31:42.260053 32179 raft_consensus.cc:348] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.260260 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.259767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:47553)
0811 01:31:42.259922 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.260016 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 01:31:42.260306 32179 raft_consensus.cc:374] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:42.260414 32179 raft_consensus.cc:729] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d503ef7ee3084b03b24d53b6795b1b4b, State: Initialized, Role: FOLLOWER
I20260811 01:31:42.260687 32179 consensus_queue.cc:260] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.261475 32179 ts_tablet_manager.cc:1428] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 01:31:42.263978 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.262087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:54831)
0811 01:31:42.263487 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.263661 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1266,"thread_start_us":1089,"threads_started":1}
I20260811 01:31:42.264065 31895 heartbeater.cc:503] Master 127.23.39.252:44117 was elected leader, sending a full tablet report...
I20260811 01:31:42.265122 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.264721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:43719)
0811 01:31:42.264921 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.265002 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 01:31:42.460507 32176 raft_consensus.cc:482] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:42.460808 32176 raft_consensus.cc:504] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.462505 32176 leader_election.cc:288] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721), d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:42.468852 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.462902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60409 (local address 127.23.39.195:38721)
0811 01:31:42.463120 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.463126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.463148 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:31:42.463366 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.463370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.463432 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.463502 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.464083 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.464843 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.467084 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.467887 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.468073 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.468151 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.468440 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.468580 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:31:42.468878 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.463164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:35479 (local address 127.23.39.194:34559)
0811 01:31:42.463363 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.463367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.463382 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:31:42.463457 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.463460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.463549 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.463649 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:42.464155 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.464854 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.467138 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.467905 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.468075 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.468158 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.468460 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.468597 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:31:42.468901 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.462750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:38721 (local address 127.23.39.193:60409)
0811 01:31:42.462964 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.462988 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.463155 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.463549 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.463554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.463592 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.463924 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.463936 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.464975 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.464981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.466926 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.466939 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.468087 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.468093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.468272 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.468298 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.468399 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.468550 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":24}
I20260811 01:31:42.468918 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.462750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34559 (local address 127.23.39.193:35479)
0811 01:31:42.463048 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.463081 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:42.463201 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:42.463686 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:42.463689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:42.463710 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:42.463984 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.464013 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.465014 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.465019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.466991 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:42.467003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.468148 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.468154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:42.468312 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.468334 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 01:31:42.468432 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:31:42.468574 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":266}
I20260811 01:31:42.469892 32009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afccb5a0a9a24a48bbf2e02c301a182c" candidate_uuid: "86163ec230ce4d78b4020696079083d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e07fd71c214f51bc1a29509d50ccff" is_pre_election: true
I20260811 01:31:42.470220 32009 raft_consensus.cc:2454] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86163ec230ce4d78b4020696079083d2 in term 0.
I20260811 01:31:42.470156 31844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afccb5a0a9a24a48bbf2e02c301a182c" candidate_uuid: "86163ec230ce4d78b4020696079083d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" is_pre_election: true
I20260811 01:31:42.470643 31844 raft_consensus.cc:2454] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86163ec230ce4d78b4020696079083d2 in term 0.
I20260811 01:31:42.470891 31603 leader_election.cc:302] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86163ec230ce4d78b4020696079083d2, a0e07fd71c214f51bc1a29509d50ccff; no voters:
I20260811 01:31:42.471653 32176 raft_consensus.cc:2781] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:42.471794 32176 raft_consensus.cc:482] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:42.471903 32176 raft_consensus.cc:3037] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:42.474257 32176 raft_consensus.cc:504] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.474943 32176 leader_election.cc:288] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [CANDIDATE]: Term 1 election: Requested vote from peers a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721), d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559)
I20260811 01:31:42.475632 32009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afccb5a0a9a24a48bbf2e02c301a182c" candidate_uuid: "86163ec230ce4d78b4020696079083d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0e07fd71c214f51bc1a29509d50ccff"
I20260811 01:31:42.475647 31844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afccb5a0a9a24a48bbf2e02c301a182c" candidate_uuid: "86163ec230ce4d78b4020696079083d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d503ef7ee3084b03b24d53b6795b1b4b"
I20260811 01:31:42.475863 32009 raft_consensus.cc:3037] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:42.475879 31844 raft_consensus.cc:3037] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:42.477991 32009 raft_consensus.cc:2454] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86163ec230ce4d78b4020696079083d2 in term 1.
I20260811 01:31:42.478113 31844 raft_consensus.cc:2454] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86163ec230ce4d78b4020696079083d2 in term 1.
I20260811 01:31:42.478566 31603 leader_election.cc:302] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86163ec230ce4d78b4020696079083d2, a0e07fd71c214f51bc1a29509d50ccff; no voters:
I20260811 01:31:42.478890 32176 raft_consensus.cc:2781] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:42.479346 32176 raft_consensus.cc:686] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 1 LEADER]: Becoming Leader. State: Replica: 86163ec230ce4d78b4020696079083d2, State: Running, Role: LEADER
I20260811 01:31:42.479962 32176 consensus_queue.cc:237] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } }
I20260811 01:31:42.480496 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.479997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:47897)
0811 01:31:42.480178 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.480315 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 01:31:42.483696 31520 catalog_manager.cc:5495] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86163ec230ce4d78b4020696079083d2 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "86163ec230ce4d78b4020696079083d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86163ec230ce4d78b4020696079083d2" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 } health_report { overall_health: UNKNOWN } } }
I20260811 01:31:42.536644 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.531289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51258 (local address 127.23.39.193:33643)
0811 01:31:42.531497 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.531501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.531517 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:31:42.531616 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.531619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.531698 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.531881 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:42.532245 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.532977 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.534394 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.534867 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.534998 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.535499 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:42.536045 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:42.536205 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.536273 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.536358 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:31:42.541431 32009 raft_consensus.cc:1261] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Refusing update from remote peer 86163ec230ce4d78b4020696079083d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:42.541615 31844 raft_consensus.cc:1261] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Refusing update from remote peer 86163ec230ce4d78b4020696079083d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:42.542256 32185 consensus_queue.cc:1035] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0e07fd71c214f51bc1a29509d50ccff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 38721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:42.542747 32176 consensus_queue.cc:1035] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d503ef7ee3084b03b24d53b6795b1b4b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:42.545786 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.545256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:45311)
0811 01:31:42.545489 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.545608 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 01:31:42.545804 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.545256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:54527)
0811 01:31:42.545489 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.545606 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260811 01:31:42.553535 32188 mvcc.cc:205] Tried to move back new op lower bound from 7317143152801857536 to 7317143152562286592. Current Snapshot: MvccSnapshot[applied={T|T < 7317143152801857536}]
I20260811 01:31:42.556630 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.556018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.195:54403)
0811 01:31:42.556330 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.556441 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260811 01:31:42.559268 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.558466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.194:37331)
0811 01:31:42.558874 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.559002 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238}
I20260811 01:31:42.564435 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.556119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.23.39.193:37387)
0811 01:31:42.564011 (+ 7892us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.564195 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7704}
I20260811 01:31:42.570601 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.570035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40924)
0811 01:31:42.570314 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.570426 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260811 01:31:42.571751 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.571405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40940)
0811 01:31:42.571531 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:42.571623 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 01:31:42.576171 31520 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:42.576462 31520 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:42.582289 31520 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e43253350cb54f0bb531fac4a0d6105e: Sending DeleteTablet for 3 replicas of tablet afccb5a0a9a24a48bbf2e02c301a182c
I20260811 01:31:42.583559 31985 tablet_service.cc:1514] Processing DeleteTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:42 UTC) from {username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:44850
I20260811 01:31:42.584080 31655 tablet_service.cc:1514] Processing DeleteTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:42 UTC) from {username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:51242
I20260811 01:31:42.584810 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 31495
I20260811 01:31:42.585632 31822 tablet_service.cc:1514] Processing DeleteTablet for tablet afccb5a0a9a24a48bbf2e02c301a182c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:42 UTC) from {username='oryx', principal='oryx/127.23.39.252@KRBTEST.COM'} at 127.0.0.1:36866
I20260811 01:31:42.586846 32200 tablet_replica.cc:330] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: stopping tablet replica
I20260811 01:31:42.587137 32200 raft_consensus.cc:2229] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:42.587582 32200 raft_consensus.cc:2258] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:42.588953 32200 ts_tablet_manager.cc:1905] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:42.597498 32199 tablet_replica.cc:330] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: stopping tablet replica
I20260811 01:31:42.598990 32199 raft_consensus.cc:2229] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:42.599545 32200 ts_tablet_manager.cc:1918] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:42.599741 32200 log.cc:1196] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/afccb5a0a9a24a48bbf2e02c301a182c
I20260811 01:31:42.600311 32200 ts_tablet_manager.cc:1939] T afccb5a0a9a24a48bbf2e02c301a182c P d503ef7ee3084b03b24d53b6795b1b4b: Deleting consensus metadata
I20260811 01:31:42.600337 32198 tablet_replica.cc:330] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: stopping tablet replica
I20260811 01:31:42.600535 32198 raft_consensus.cc:2229] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:42.600891 32198 raft_consensus.cc:2258] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:42.601708 32199 raft_consensus.cc:2258] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:42.601969 31504 catalog_manager.cc:4841] TS d503ef7ee3084b03b24d53b6795b1b4b (127.23.39.194:34559): tablet afccb5a0a9a24a48bbf2e02c301a182c (table test-table [id=e41b5631fcf34f91a3142b924663a564]) successfully deleted
I20260811 01:31:42.602798 32198 ts_tablet_manager.cc:1905] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:42.603605 32199 ts_tablet_manager.cc:1905] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:42.609683 32198 ts_tablet_manager.cc:1918] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:42.609849 32198 log.cc:1196] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/afccb5a0a9a24a48bbf2e02c301a182c
I20260811 01:31:42.610338 32198 ts_tablet_manager.cc:1939] T afccb5a0a9a24a48bbf2e02c301a182c P a0e07fd71c214f51bc1a29509d50ccff: Deleting consensus metadata
I20260811 01:31:42.611639 31503 catalog_manager.cc:4841] TS a0e07fd71c214f51bc1a29509d50ccff (127.23.39.195:38721): tablet afccb5a0a9a24a48bbf2e02c301a182c (table test-table [id=e41b5631fcf34f91a3142b924663a564]) successfully deleted
I20260811 01:31:42.611302 32199 ts_tablet_manager.cc:1918] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:42.612114 32199 log.cc:1196] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/afccb5a0a9a24a48bbf2e02c301a182c
I20260811 01:31:42.612674 32199 ts_tablet_manager.cc:1939] T afccb5a0a9a24a48bbf2e02c301a182c P 86163ec230ce4d78b4020696079083d2: Deleting consensus metadata
I20260811 01:31:42.613914 31505 catalog_manager.cc:4841] TS 86163ec230ce4d78b4020696079083d2 (127.23.39.193:33643): tablet afccb5a0a9a24a48bbf2e02c301a182c (table test-table [id=e41b5631fcf34f91a3142b924663a564]) successfully deleted
I20260811 01:31:42.614923 32167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.586357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.23.39.193:33643)
0811 01:31:42.590349 (+ 3992us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.590355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.590376 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:31:42.590437 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.590442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.590531 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.590645 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:42.592698 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.595185 (+ 2487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.597744 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.598538 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.598648 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.605518 (+ 6870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:42.605538 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:42.605563 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:42.605624 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:42.610433 (+ 4809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.611498 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.611514 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.611517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.612117 (+ 600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.612701 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.612707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.612710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.613190 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:42.613485 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.614297 (+ 812us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.614536 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3839}
I20260811 01:31:42.615816 31723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:42.731225 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 31495
I20260811 01:31:42.756526 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 31742
I20260811 01:31:42.774309 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.757397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36872 (local address 127.23.39.194:34559)
0811 01:31:42.757703 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.757712 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.757877 (+ 165us) server_negotiation.cc:407] Connection header received
0811 01:31:42.758104 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.758110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.758239 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.758356 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:42.759832 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.760610 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.762043 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.762592 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.762748 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.765934 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:42.765955 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:42.765972 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:42.766023 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:42.769595 (+ 3572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.771225 (+ 1630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.771235 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.771238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.771448 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.772156 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.772165 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.772171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.772690 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:42.773035 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.773509 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.773904 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:31:42.775070 31890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:42.922320 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 31742
I20260811 01:31:42.953648 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 31909
I20260811 01:31:42.971549 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:42.954622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44860 (local address 127.23.39.195:38721)
0811 01:31:42.954854 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:42.954864 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:42.954889 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:42.955129 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:42.955135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:42.955228 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:42.955365 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:42.956971 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.957924 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.959796 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:42.960251 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:42.960411 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:42.963574 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:42.963598 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:42.963618 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:42.963675 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:42.967709 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.968808 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.968822 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.968832 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.969013 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:42.969520 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:42.969526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:42.969529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:42.970021 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:42.970442 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:42.970850 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 01:31:42.971146 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:31:42.972484 32053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:43.069624 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 31909
I20260811 01:31:43.082620 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:43.081632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40956)
0811 01:31:43.082215 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:43.082362 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":277,"threads_started":1}
I20260811 01:31:43.084085 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:43.083718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36077 (local address 127.0.0.1:40966)
0811 01:31:43.083887 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:43.083964 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:36077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 01:31:43.093329 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 31144
I20260811 01:31:43.094705 31337 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:43.222931 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 31144
I20260811 01:31:43.250795 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 31258
I20260811 01:31:43.252010 31561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:43.378762 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 31258
2026-08-11T01:31:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10997 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:43 dist-test-slave-9jjr krb5kdc[32211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:43 dist-test-slave-9jjr krb5kdc[32211](info): set up 2 sockets
Aug 11 01:31:43 dist-test-slave-9jjr krb5kdc[32211](info): commencing operation
krb5kdc: starting...
W20260811 01:31:44.570441 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:44 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab.
Entry for principal oryx/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab.
I20260811 01:31:44.874358 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36145
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab
--principal=oryx/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:45.227027 32226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:45.227398 32226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:45.227550 32226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:45.235412 32226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:45.235567 32226 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 01:31:45.235641 32226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:45.235733 32226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:45.235823 32226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:45.235913 32226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:45.246217 32226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36145
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.254.keytab
--principal=oryx/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:45.247674 32226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:45.249073 32226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:45.262359 32236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:45.262406 32234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:45.262437 32231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:45.263118 32226 server_base.cc:1034] running on GCE node
I20260811 01:31:45.264040 32226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:45.265588 32226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:45.266839 32226 hybrid_clock.cc:648] HybridClock initialized: now 1786411905266774 us; error 40 us; skew 500 ppm
I20260811 01:31:45.267185 32226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:45 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411905, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:45.274310 32226 init.cc:377] Logged in from keytab as oryx/127.23.39.254@KRBTEST.COM (short username oryx)
I20260811 01:31:45.275985 32226 webserver.cc:460] Webserver started at http://127.23.39.254:33417/ using document root <none> and password file <none>
I20260811 01:31:45.276777 32226 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:45.276914 32226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:45.277274 32226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:45.280524 32226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "72734e294240497cbd0a6489595dda92"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "8544f170f7b610d95535654b9858e916"
server_key_iv: "c69dd425e5e5c00bd40b3487d64fd6fa"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.281411 32226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "72734e294240497cbd0a6489595dda92"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "8544f170f7b610d95535654b9858e916"
server_key_iv: "c69dd425e5e5c00bd40b3487d64fd6fa"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.287113 32226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:31:45.290809 32243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:45.292300 32226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:45.292523 32226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "72734e294240497cbd0a6489595dda92"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "8544f170f7b610d95535654b9858e916"
server_key_iv: "c69dd425e5e5c00bd40b3487d64fd6fa"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.292786 32226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:45.307564 32226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:45.312479 32226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:45.312790 32226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:45.335992 32226 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:36145
I20260811 01:31:45.336017 32312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:36145 every 8 connection(s)
I20260811 01:31:45.337544 32226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:45.341593 32313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:45.344110 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 32226
I20260811 01:31:45.344336 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:45.345161 23711 external_mini_cluster.cc:1428] Setting key af6edb5add9c3af37f1f4f61b272c33c
I20260811 01:31:45.355316 32313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Bootstrap starting.
I20260811 01:31:45.359661 32313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Neither blocks nor log segments found. Creating new log.
Aug 11 01:31:45 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:45.360991 32313 log.cc:824] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:45.364372 32313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: No bootstrap required, opened a new log
I20260811 01:31:45.369791 32316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:45.347417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41438 (local address 127.23.39.254:36145)
0811 01:31:45.348278 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:45.348291 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:45.348332 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:31:45.350067 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:45.350090 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:45.350542 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:45.350868 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:45.352790 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:45.354223 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:45.355996 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:45.356697 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:45.356896 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:45.361900 (+ 5004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:45.361909 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:45.361924 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:45.361972 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:45.365418 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:45.366220 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:45.366228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:45.366237 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:45.366424 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:45.366846 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:45.366852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:45.366855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:45.367457 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:45.367803 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:45.368227 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 01:31:45.368705 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":425,"threads_started":1}
I20260811 01:31:45.372594 32313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } }
I20260811 01:31:45.373098 32313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:45.373219 32313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72734e294240497cbd0a6489595dda92, State: Initialized, Role: FOLLOWER
I20260811 01:31:45.373787 32313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } }
I20260811 01:31:45.374053 32313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:45.374213 32313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:45.374408 32313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:45.376726 32313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } }
I20260811 01:31:45.377326 32313 leader_election.cc:302] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72734e294240497cbd0a6489595dda92; no voters:
I20260811 01:31:45.377933 32313 leader_election.cc:288] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:45.378091 32318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:45.379701 32318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [term 1 LEADER]: Becoming Leader. State: Replica: 72734e294240497cbd0a6489595dda92, State: Running, Role: LEADER
I20260811 01:31:45.380283 32318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } }
I20260811 01:31:45.380486 32313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:45.383399 32319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72734e294240497cbd0a6489595dda92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } } }
I20260811 01:31:45.383478 32320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72734e294240497cbd0a6489595dda92. Latest consensus state: current_term: 1 leader_uuid: "72734e294240497cbd0a6489595dda92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72734e294240497cbd0a6489595dda92" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36145 } } }
I20260811 01:31:45.383826 32319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:45.383854 32320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92 [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:45.387388 32326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:45.392943 32326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:45.402890 32326 catalog_manager.cc:1347] Generated new cluster ID: 6e294fc5645641e58c15dee6cd0cd312
I20260811 01:31:45.403034 32326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:45.424166 32326 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:45.425643 32326 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:45.437708 32326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Generated new TSK 0
I20260811 01:31:45.438751 32326 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
I20260811 01:31:45.512205 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36145
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:45.883769 32339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:45.884095 32339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:45.884209 32339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:45.892148 32339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:45.892279 32339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:45.892367 32339 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:31:45.892454 32339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:45.904151 32339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:45.905557 32339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:45.907042 32339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:45.921026 32344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:45.921067 32345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:45.921105 32347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:45.922399 32339 server_base.cc:1034] running on GCE node
I20260811 01:31:45.923157 32339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:45.924145 32339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:45.925419 32339 hybrid_clock.cc:648] HybridClock initialized: now 1786411905925351 us; error 50 us; skew 500 ppm
I20260811 01:31:45.925766 32339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:45 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411905, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:45.929490 32339 init.cc:377] Logged in from keytab as oryx/127.23.39.193@KRBTEST.COM (short username oryx)
I20260811 01:31:45.931505 32339 webserver.cc:460] Webserver started at http://127.23.39.193:35653/ using document root <none> and password file <none>
I20260811 01:31:45.932401 32339 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:45.932552 32339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:45.932914 32339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:45.936403 32339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "5abd60c77937424a80c98925c2041918"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "43e4a76a571ea9385bbf22100009dcd6"
server_key_iv: "c87f3e1f48ba9cb479ab0dd4bf7fa16b"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.937562 32339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "5abd60c77937424a80c98925c2041918"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "43e4a76a571ea9385bbf22100009dcd6"
server_key_iv: "c87f3e1f48ba9cb479ab0dd4bf7fa16b"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.943830 32339 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 01:31:45.947829 32355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:45.949373 32339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:31:45.949609 32339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "5abd60c77937424a80c98925c2041918"
format_stamp: "Formatted at 2026-08-11 01:31:45 on dist-test-slave-9jjr"
server_key: "43e4a76a571ea9385bbf22100009dcd6"
server_key_iv: "c87f3e1f48ba9cb479ab0dd4bf7fa16b"
server_key_version: "encryptionkey@0"
I20260811 01:31:45.949925 32339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:45.978163 32339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:45.983346 32339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:45.983677 32339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:45.986665 32339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:45.986788 32339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:45.986959 32339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:45.987059 32339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:31:46 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411905, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:46.017694 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:45.987572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:56327 (local address 127.23.39.254:36145)
0811 01:31:45.988082 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:45.988088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:45.989790 (+ 1702us) server_negotiation.cc:407] Connection header received
0811 01:31:45.993218 (+ 3428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:45.993226 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:45.993349 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:45.993527 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:45.996772 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:45.997593 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.001298 (+ 3705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.002185 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.002382 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.007927 (+ 5545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:46.007939 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:46.007948 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:46.008016 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:46.012717 (+ 4701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.014063 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.014072 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.014077 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.014342 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.014995 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.015003 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.015009 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.015501 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:46.015707 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:46.016966 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0811 01:31:46.017277 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":1305,"threads_started":1}
I20260811 01:31:46.019413 32365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:45.988581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.193:56327)
0811 01:31:45.989561 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:45.989618 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:45.992752 (+ 3134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:45.993880 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:45.993896 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:45.995067 (+ 1171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:45.996382 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:45.996425 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:45.997877 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:45.997882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.000996 (+ 3114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.001018 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.002452 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.002457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.002661 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.003575 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:46.003619 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:46.007511 (+ 3892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:46.012991 (+ 5480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.013006 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.013035 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.013856 (+ 821us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.014469 (+ 613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.014476 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.014479 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.014809 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.015703 (+ 894us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:46.015716 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:46.016392 (+ 676us) client_negotiation.cc:769] Sending connection context
0811 01:31:46.016837 (+ 445us) client_negotiation.cc:240] Negotiation successful
0811 01:31:46.017517 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":352,"threads_started":1}
I20260811 01:31:46.042045 32339 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:34659
I20260811 01:31:46.042013 32495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:34659 every 8 connection(s)
I20260811 01:31:46.043136 32462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.026825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.193:37351)
0811 01:31:46.027716 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:46.027742 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:46.027922 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:46.028289 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:46.028293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:46.028823 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:46.029184 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.029195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.030322 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.030333 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.032195 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.032220 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.033274 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.033279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.033429 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.034453 (+ 1024us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:46.034487 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:46.035641 (+ 1154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:46.040096 (+ 4455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.040102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.040106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.040582 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.041005 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.041010 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.041014 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.041238 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.042080 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:46.042086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:46.042349 (+ 263us) client_negotiation.cc:769] Sending connection context
0811 01:31:46.042481 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 01:31:46.042790 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":512,"threads_started":1}
I20260811 01:31:46.043272 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.026668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:37351 (local address 127.23.39.254:36145)
0811 01:31:46.026901 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:46.026909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:46.027844 (+ 935us) server_negotiation.cc:407] Connection header received
0811 01:31:46.028079 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:46.028083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:46.028153 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:46.028263 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:46.029343 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.030155 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.032456 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.032917 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.033000 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.036006 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:46.036015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:46.036023 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:46.036075 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:46.039932 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.040745 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.040750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.040753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.040887 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.041403 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.041412 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.041419 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.041920 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:46.042112 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:46.042623 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 01:31:46.042908 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:31:46.043931 32339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:46.045317 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 32339
I20260811 01:31:46.045532 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:46.046272 23711 external_mini_cluster.cc:1428] Setting key 69ce8d407d3483127195083a2a23f6fc
I20260811 01:31:46.048331 32496 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36145
I20260811 01:31:46.048599 32496 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:46.049283 32496 heartbeater.cc:511] Master 127.23.39.254:36145 requested a full tablet report, sending...
I20260811 01:31:46.051474 32261 ts_manager.cc:194] Registered new tserver with Master: 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659)
I20260811 01:31:46.053043 32261 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:56327
WARNING: no policy specified for oryx/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
I20260811 01:31:46.113349 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36145
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:46.475201 32500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:46.475581 32500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:46.475764 32500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:46.483438 32500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:46.483601 32500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:46.483754 32500 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:31:46.483893 32500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:46.494251 32500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:46.496086 32500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:46.497618 32500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:46.511313 32505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:46.511353 32506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:46.511368 32508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:46.512351 32500 server_base.cc:1034] running on GCE node
I20260811 01:31:46.513037 32500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:46.514058 32500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:46.515364 32500 hybrid_clock.cc:648] HybridClock initialized: now 1786411906515290 us; error 42 us; skew 500 ppm
I20260811 01:31:46.515751 32500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:46 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411906, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:46.519130 32500 init.cc:377] Logged in from keytab as oryx/127.23.39.194@KRBTEST.COM (short username oryx)
I20260811 01:31:46.520910 32500 webserver.cc:460] Webserver started at http://127.23.39.194:46497/ using document root <none> and password file <none>
I20260811 01:31:46.521735 32500 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:46.521875 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:46.522287 32500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:46.525410 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "e60ffd2c22c64da19d4a0733c92880e7"
format_stamp: "Formatted at 2026-08-11 01:31:46 on dist-test-slave-9jjr"
server_key: "6f425a341b5745de92bf767a40e8f5fa"
server_key_iv: "9ddfc84615cdb88e06b9093eeeb55393"
server_key_version: "encryptionkey@0"
I20260811 01:31:46.526337 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "e60ffd2c22c64da19d4a0733c92880e7"
format_stamp: "Formatted at 2026-08-11 01:31:46 on dist-test-slave-9jjr"
server_key: "6f425a341b5745de92bf767a40e8f5fa"
server_key_iv: "9ddfc84615cdb88e06b9093eeeb55393"
server_key_version: "encryptionkey@0"
I20260811 01:31:46.533082 32500 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:31:46.536881 32517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:46.538379 32500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:46.538574 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "e60ffd2c22c64da19d4a0733c92880e7"
format_stamp: "Formatted at 2026-08-11 01:31:46 on dist-test-slave-9jjr"
server_key: "6f425a341b5745de92bf767a40e8f5fa"
server_key_iv: "9ddfc84615cdb88e06b9093eeeb55393"
server_key_version: "encryptionkey@0"
I20260811 01:31:46.538834 32500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:46.551225 32500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:46.556690 32500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:46.556991 32500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:46.560211 32500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:46.560442 32500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:46.560606 32500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:46.560698 32500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:31:46 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411906, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:46.587833 32528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.560907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:38097 (local address 127.23.39.254:36145)
0811 01:31:46.563495 (+ 2588us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:46.563501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:46.563540 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:31:46.565212 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:46.565217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:46.565324 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:46.565449 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:46.567957 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.569286 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.572905 (+ 3619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.573681 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.573834 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.579399 (+ 5565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:46.579404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:46.579408 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:46.579485 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:46.583095 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.584276 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.584280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.584283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.584414 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.584997 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.585002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.585006 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.585430 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:46.585608 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:46.587165 (+ 1557us) server_negotiation.cc:299] Negotiation successful
0811 01:31:46.587425 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2429,"thread_start_us":2312,"threads_started":1}
I20260811 01:31:46.588819 32530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.561598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.194:38097)
0811 01:31:46.562540 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:46.562606 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:46.564878 (+ 2272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:46.565723 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:46.565732 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:46.566696 (+ 964us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:46.567680 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.567712 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.569495 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.569507 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.572686 (+ 3179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.572708 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.573950 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.573957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.574248 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.575083 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:46.575120 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:46.579058 (+ 3938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:46.583339 (+ 4281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.583355 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.583381 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.584088 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.584589 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.584595 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.584601 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.584870 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.585587 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:46.585595 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:46.586240 (+ 645us) client_negotiation.cc:769] Sending connection context
0811 01:31:46.586652 (+ 412us) client_negotiation.cc:240] Negotiation successful
0811 01:31:46.587326 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":441,"threads_started":1}
I20260811 01:31:46.612105 32500 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:46281
I20260811 01:31:46.612140 32652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:46281 every 8 connection(s)
I20260811 01:31:46.612998 32616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.596100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.194:50163)
0811 01:31:46.597378 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:46.597404 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:46.597660 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:46.598033 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:46.598038 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:46.598706 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:46.599220 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.599233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.600413 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.600416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.603556 (+ 3140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:46.603570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.604578 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.604584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:46.604751 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.605491 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:46.605509 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:46.606417 (+ 908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:46.610283 (+ 3866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.610288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.610293 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.610716 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.611161 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:46.611168 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:46.611174 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:46.611352 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:46.611952 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:46.611957 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:46.612177 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 01:31:46.612327 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 01:31:46.612663 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1020,"thread_start_us":848,"threads_started":1}
I20260811 01:31:46.613667 32500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:46.613770 32528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:46.595623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:50163 (local address 127.23.39.254:36145)
0811 01:31:46.595833 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:46.595842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:46.597510 (+ 1668us) server_negotiation.cc:407] Connection header received
0811 01:31:46.597805 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:46.597810 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:46.597890 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:46.597992 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:46.599463 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.600246 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.603803 (+ 3557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:46.604377 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:46.604520 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:46.606624 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:46.606629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:46.606633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:46.606672 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:46.610100 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.610850 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.610856 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.610860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.610991 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:46.611487 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:46.611490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:46.611492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:46.611829 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:46.611987 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:46.613341 (+ 1354us) server_negotiation.cc:299] Negotiation successful
0811 01:31:46.613525 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:31:46.614315 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 32500
I20260811 01:31:46.614517 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:46.615223 23711 external_mini_cluster.cc:1428] Setting key 4568701e317d6ff4b8955c506ac2dfd0
I20260811 01:31:46.617959 32653 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36145
I20260811 01:31:46.618304 32653 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:46.619195 32653 heartbeater.cc:511] Master 127.23.39.254:36145 requested a full tablet report, sending...
I20260811 01:31:46.620760 32261 ts_manager.cc:194] Registered new tserver with Master: e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281)
I20260811 01:31:46.621691 32261 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:38097
WARNING: no policy specified for oryx/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
I20260811 01:31:46.689561 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:36145
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:47.051613 32657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:47.051973 32657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:47.052142 32657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 01:31:47.056447 32496 heartbeater.cc:503] Master 127.23.39.254:36145 was elected leader, sending a full tablet report...
W20260811 01:31:47.060659 32657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:47.060822 32657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:47.060985 32657 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 01:31:47.061123 32657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:47.071993 32657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.39.254:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:47.073462 32657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:47.075014 32657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:47.089366 32663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:47.089463 32665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:47.089694 32667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:47.090855 32657 server_base.cc:1034] running on GCE node
I20260811 01:31:47.091609 32657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:47.092715 32657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:47.093961 32657 hybrid_clock.cc:648] HybridClock initialized: now 1786411907093878 us; error 61 us; skew 500 ppm
I20260811 01:31:47.094334 32657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:47 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411907, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:47.097872 32657 init.cc:377] Logged in from keytab as oryx/127.23.39.195@KRBTEST.COM (short username oryx)
I20260811 01:31:47.099661 32657 webserver.cc:460] Webserver started at http://127.23.39.195:35149/ using document root <none> and password file <none>
I20260811 01:31:47.100431 32657 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:47.100565 32657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:47.100915 32657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:47.104153 32657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
format_stamp: "Formatted at 2026-08-11 01:31:47 on dist-test-slave-9jjr"
server_key: "ca4b4e67fbc80fa42069b1b6d90a3db8"
server_key_iv: "6ee7e500400c124843be94b09a373c8c"
server_key_version: "encryptionkey@0"
I20260811 01:31:47.105018 32657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
format_stamp: "Formatted at 2026-08-11 01:31:47 on dist-test-slave-9jjr"
server_key: "ca4b4e67fbc80fa42069b1b6d90a3db8"
server_key_iv: "6ee7e500400c124843be94b09a373c8c"
server_key_version: "encryptionkey@0"
I20260811 01:31:47.110677 32657 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:31:47.114528 32677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:47.115947 32657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:47.116139 32657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
format_stamp: "Formatted at 2026-08-11 01:31:47 on dist-test-slave-9jjr"
server_key: "ca4b4e67fbc80fa42069b1b6d90a3db8"
server_key_iv: "6ee7e500400c124843be94b09a373c8c"
server_key_version: "encryptionkey@0"
I20260811 01:31:47.116390 32657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:47.137005 32657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:47.141865 32657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:47.142223 32657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:47.145241 32657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:47.145373 32657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:47.145534 32657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:47.145605 32657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:31:47 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411907, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:47.173301 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:47.146230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:42085 (local address 127.23.39.254:36145)
0811 01:31:47.146718 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:47.146723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:47.148087 (+ 1364us) server_negotiation.cc:407] Connection header received
0811 01:31:47.150596 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:47.150602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:47.150705 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:47.150828 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:47.153259 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.154791 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.157865 (+ 3074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.158564 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.158721 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:47.164505 (+ 5784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:47.164516 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:47.164522 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:47.164580 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:47.168387 (+ 3807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:47.169592 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:47.169598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:47.169602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:47.169793 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:47.170583 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:47.170589 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:47.170593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:47.171067 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:47.171200 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:47.172475 (+ 1275us) server_negotiation.cc:299] Negotiation successful
0811 01:31:47.172764 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":251,"threads_started":1}
I20260811 01:31:47.176164 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:47.146964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.195:42085)
0811 01:31:47.147902 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:47.147950 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:47.150248 (+ 2298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:47.151113 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:47.151123 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:47.152004 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:47.152994 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:47.153020 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.155081 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.155087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:47.157609 (+ 2522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:47.157639 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.158863 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.158872 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:47.159281 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:47.160242 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:47.160285 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:47.164020 (+ 3735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:47.168621 (+ 4601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:47.168631 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:47.168652 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:47.169430 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:47.169937 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:47.169941 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:47.169947 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:47.170380 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:47.171312 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:47.171323 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:47.171916 (+ 593us) client_negotiation.cc:769] Sending connection context
0811 01:31:47.173580 (+ 1664us) client_negotiation.cc:240] Negotiation successful
0811 01:31:47.174358 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":369,"threads_started":1}
I20260811 01:31:47.192826 32657 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:39057
I20260811 01:31:47.192847 349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:39057 every 8 connection(s)
I20260811 01:31:47.194386 32657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:47.196767 350 heartbeater.cc:347] Connected to a master server at 127.23.39.254:36145
I20260811 01:31:47.197028 350 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:47.198043 350 heartbeater.cc:511] Master 127.23.39.254:36145 requested a full tablet report, sending...
I20260811 01:31:47.199712 32261 ts_manager.cc:194] Registered new tserver with Master: 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:47.200407 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 32657
I20260811 01:31:47.200583 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:47.200911 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:47.184404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:54013 (local address 127.23.39.254:36145)
0811 01:31:47.184618 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:47.184625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:47.185905 (+ 1280us) server_negotiation.cc:407] Connection header received
0811 01:31:47.186189 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:47.186194 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:47.186298 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:47.186421 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:47.187935 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.188741 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.190931 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.191630 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.191771 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:47.194098 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:47.194104 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:47.194107 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:47.194191 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:47.197867 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:47.198682 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:47.198688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:47.198692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:47.198884 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:47.199319 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:47.199325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:47.199328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:47.199626 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:47.199840 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:47.200263 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 01:31:47.200506 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:31:47.200965 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:47.184502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.23.39.195:54013)
0811 01:31:47.185740 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:47.185768 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:47.185990 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:47.186466 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:47.186471 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:47.187274 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:47.187742 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:47.187764 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.188907 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.188915 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:47.190735 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:47.190752 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.192058 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.192065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:47.192306 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:47.193009 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:47.193028 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:47.193863 (+ 835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:47.198004 (+ 4141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:47.198008 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:47.198011 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:47.198548 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:47.199049 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:47.199054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:47.199058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:47.199196 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:47.199768 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:47.199773 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:47.199991 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 01:31:47.200137 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 01:31:47.200506 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":825,"threads_started":1}
I20260811 01:31:47.200958 32261 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:42085
I20260811 01:31:47.201105 23711 external_mini_cluster.cc:1428] Setting key e061644dd1e2258e0a439b9cf3201792
I20260811 01:31:47.204778 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 01:31:47 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411907, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 01:31:47 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:31:47 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:31:47.625191 32653 heartbeater.cc:503] Master 127.23.39.254:36145 was elected leader, sending a full tablet report...
I20260811 01:31:48.204591 350 heartbeater.cc:503] Master 127.23.39.254:36145 was elected leader, sending a full tablet report...
W20260811 01:31:48.400923 360 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.133s user 0.005s sys 0.016s
W20260811 01:31:48.402238 32690 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:47.262108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45166 (local address 127.23.39.254:36145)
0811 01:31:47.262322 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:47.262327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:47.262649 (+ 322us) server_negotiation.cc:407] Connection header received
0811 01:31:47.262822 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:47.262826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:47.262908 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:47.263008 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:47.264459 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.265205 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.266657 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:47.267107 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:47.267213 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.401922 (+1134709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45166: BlockingRecv error: recv got EOF from 127.0.0.1:45166 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 01:31:48 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411907, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:48.422114 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.406997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45170 (local address 127.23.39.254:36145)
0811 01:31:48.407264 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.407272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.407517 (+ 245us) server_negotiation.cc:407] Connection header received
0811 01:31:48.407661 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.407665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.407734 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.407833 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:48.409149 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.409880 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.411229 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.411638 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.411737 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.415901 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:48.415906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:48.415909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:48.415949 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:48.418959 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:48.419738 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:48.419743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:48.419745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:48.419888 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:48.420354 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:48.420359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:48.420364 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:48.420755 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:48.421105 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.421451 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.421748 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 01:31:48.427148 32262 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:48.434922 32262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:48.471623 374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.448338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46281 (local address 127.0.0.1:51438)
0811 01:31:48.455199 (+ 6861us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:48.455308 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:48.455622 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:48.463038 (+ 7416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:48.463045 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:48.463092 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:48.463615 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.463636 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.465911 (+ 2275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.465917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.468321 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.468342 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.470405 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.470412 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.470634 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.470714 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 01:31:48.470868 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 01:31:48.471103 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":1,"thread_start_us":340,"threads_started":1}
I20260811 01:31:48.471719 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.449878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41188 (local address 127.23.39.195:39057)
0811 01:31:48.460269 (+ 10391us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.460279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.462420 (+ 2141us) server_negotiation.cc:407] Connection header received
0811 01:31:48.462520 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.462527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.462740 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.463538 (+ 798us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:48.464058 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.465645 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.469213 (+ 3568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.470569 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.470737 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.471012 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.471202 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.471396 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10210,"thread_start_us":10051,"threads_started":1}
I20260811 01:31:48.472275 375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.448555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.23.39.194:46281)
0811 01:31:48.462492 (+ 13937us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.462498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.462523 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:48.462604 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.462609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.462790 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.463015 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:48.463847 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.465717 (+ 1870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.468537 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.470117 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.471424 (+ 1307us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.471627 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.471705 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.471908 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13774,"thread_start_us":13622,"threads_started":1}
I20260811 01:31:48.472688 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.449495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57648 (local address 127.23.39.193:34659)
0811 01:31:48.462262 (+ 12767us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.462272 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.462309 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:31:48.462439 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.462448 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.462742 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.463016 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:48.464726 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.466326 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.469525 (+ 3199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.471182 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.471347 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.471562 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.472140 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.472342 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12562,"thread_start_us":13733,"threads_started":1}
I20260811 01:31:48.473011 376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.452683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:39057 (local address 127.0.0.1:41188)
0811 01:31:48.462032 (+ 9349us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:48.462063 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:48.462258 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:48.463347 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:48.463351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:48.463372 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:48.463833 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.463845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.465834 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.465843 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.468990 (+ 3147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.469005 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.470803 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.470809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.470999 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.471035 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:31:48.471134 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 01:31:48.471294 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9186,"mutex_wait_us":155,"thread_start_us":6281,"threads_started":1}
I20260811 01:31:48.473907 381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.449373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:34659 (local address 127.0.0.1:57648)
0811 01:31:48.459421 (+ 10048us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:48.459463 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:48.459664 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:48.463997 (+ 4333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:48.464004 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:48.464032 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:48.464511 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.464523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.466501 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.466508 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.469330 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.469343 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.471743 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.471750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.471931 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.471965 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:31:48.472085 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 01:31:48.472239 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9813,"thread_start_us":12309,"threads_started":1}
I20260811 01:31:48.476765 32736 tablet_service.cc:1467] Processing CreateTablet for tablet e832022df36343bdae85a0e32aca3917 (DEFAULT_TABLE table=test-table [id=b89e1f1f3e28407c806fc657dcff110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:48.476805 32575 tablet_service.cc:1467] Processing CreateTablet for tablet e832022df36343bdae85a0e32aca3917 (DEFAULT_TABLE table=test-table [id=b89e1f1f3e28407c806fc657dcff110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:48.477306 32415 tablet_service.cc:1467] Processing CreateTablet for tablet e832022df36343bdae85a0e32aca3917 (DEFAULT_TABLE table=test-table [id=b89e1f1f3e28407c806fc657dcff110c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:48.478370 32736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e832022df36343bdae85a0e32aca3917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:48.478472 32575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e832022df36343bdae85a0e32aca3917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:48.478667 32415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e832022df36343bdae85a0e32aca3917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:48.493443 382 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Bootstrap starting.
I20260811 01:31:48.494542 383 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Bootstrap starting.
I20260811 01:31:48.498202 383 tablet_bootstrap.cc:654] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:48.498203 382 tablet_bootstrap.cc:654] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:48.499648 383 log.cc:824] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:48.499647 382 log.cc:824] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:48.501032 384 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Bootstrap starting.
I20260811 01:31:48.503840 382 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: No bootstrap required, opened a new log
I20260811 01:31:48.504166 382 ts_tablet_manager.cc:1397] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.001s
I20260811 01:31:48.505532 384 tablet_bootstrap.cc:654] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:48.506918 384 log.cc:824] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:48.508216 383 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: No bootstrap required, opened a new log
I20260811 01:31:48.508544 383 ts_tablet_manager.cc:1397] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260811 01:31:48.510330 384 tablet_bootstrap.cc:492] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: No bootstrap required, opened a new log
I20260811 01:31:48.510620 384 ts_tablet_manager.cc:1397] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:31:48.515273 382 raft_consensus.cc:348] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.515825 382 raft_consensus.cc:374] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:48.515995 382 raft_consensus.cc:729] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Initialized, Role: FOLLOWER
I20260811 01:31:48.516741 382 consensus_queue.cc:260] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.517143 383 raft_consensus.cc:348] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.517889 383 raft_consensus.cc:374] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:48.518013 383 raft_consensus.cc:729] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Initialized, Role: FOLLOWER
I20260811 01:31:48.518654 383 consensus_queue.cc:260] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.521121 383 ts_tablet_manager.cc:1428] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20260811 01:31:48.521477 384 raft_consensus.cc:348] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.522017 384 raft_consensus.cc:374] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:48.522172 384 raft_consensus.cc:729] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abd60c77937424a80c98925c2041918, State: Initialized, Role: FOLLOWER
I20260811 01:31:48.522845 382 ts_tablet_manager.cc:1428] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent starting tablet: real 0.019s user 0.009s sys 0.007s
I20260811 01:31:48.522990 384 consensus_queue.cc:260] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.524956 384 ts_tablet_manager.cc:1428] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260811 01:31:48.547799 32497 tablet.cc:2369] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:31:48.618808 32654 tablet.cc:2369] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:31:48.697516 352 tablet.cc:2369] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:31:48.963680 391 raft_consensus.cc:482] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:48.964059 391 raft_consensus.cc:504] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.965811 391 leader_election.cc:288] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:48.973774 375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.966391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:37183 (local address 127.23.39.194:46281)
0811 01:31:48.966586 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.966591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.967123 (+ 532us) server_negotiation.cc:407] Connection header received
0811 01:31:48.967360 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.967366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.967465 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.967583 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:48.968297 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.969268 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.971548 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.972714 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.972899 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.972978 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.973314 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.973484 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:31:48.973876 392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.966258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46281 (local address 127.23.39.193:37183)
0811 01:31:48.967003 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:48.967025 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:48.967184 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:48.967646 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:48.967651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:48.967683 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:48.968109 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.968124 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.969411 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.969417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.971369 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.971392 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.972963 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.972972 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.973107 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.973133 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:31:48.973270 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 01:31:48.973435 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":49,"thread_start_us":380,"threads_started":1}
I20260811 01:31:48.974453 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.967480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:38035 (local address 127.23.39.195:39057)
0811 01:31:48.967702 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:48.967709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:48.967948 (+ 239us) server_negotiation.cc:407] Connection header received
0811 01:31:48.968105 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:48.968110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:48.968210 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:48.968306 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:48.968924 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.969864 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.971860 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.973093 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.973214 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.973322 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:48.974050 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 01:31:48.974239 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:31:48.975035 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:48.967147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:39057 (local address 127.23.39.193:38035)
0811 01:31:48.967827 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:48.967847 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:48.967980 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:48.968364 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:48.968371 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:48.968399 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:48.968777 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.968789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.970004 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.970008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.971703 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:48.971715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:48.973617 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:48.973626 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:48.973830 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:48.973876 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:31:48.974654 (+ 778us) client_negotiation.cc:240] Negotiation successful
0811 01:31:48.974810 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":564,"threads_started":1}
I20260811 01:31:48.974963 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e832022df36343bdae85a0e32aca3917" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7" is_pre_election: true
I20260811 01:31:48.975569 32595 raft_consensus.cc:2454] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 0.
I20260811 01:31:48.976143 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e832022df36343bdae85a0e32aca3917" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" is_pre_election: true
I20260811 01:31:48.976334 32356 leader_election.cc:302] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abd60c77937424a80c98925c2041918, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:48.976706 32762 raft_consensus.cc:2454] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 0.
I20260811 01:31:48.976773 391 raft_consensus.cc:2781] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:48.976938 391 raft_consensus.cc:482] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:48.977048 391 raft_consensus.cc:3037] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:48.979650 391 raft_consensus.cc:504] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.980396 391 leader_election.cc:288] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 election: Requested vote from peers e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:48.981089 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e832022df36343bdae85a0e32aca3917" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
I20260811 01:31:48.981088 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e832022df36343bdae85a0e32aca3917" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7"
I20260811 01:31:48.981350 32595 raft_consensus.cc:3037] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:48.981350 32762 raft_consensus.cc:3037] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:48.984963 32595 raft_consensus.cc:2454] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 1.
I20260811 01:31:48.984963 32762 raft_consensus.cc:2454] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 1.
I20260811 01:31:48.985507 32356 leader_election.cc:302] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abd60c77937424a80c98925c2041918, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:48.985832 391 raft_consensus.cc:2781] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:48.986334 391 raft_consensus.cc:686] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 1 LEADER]: Becoming Leader. State: Replica: 5abd60c77937424a80c98925c2041918, State: Running, Role: LEADER
I20260811 01:31:48.986850 391 consensus_queue.cc:237] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } }
I20260811 01:31:48.991772 32261 catalog_manager.cc:5495] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5abd60c77937424a80c98925c2041918 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } health_report { overall_health: HEALTHY } } }
I20260811 01:31:49.042697 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.036222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57652 (local address 127.23.39.193:34659)
0811 01:31:49.036705 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.036710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.037189 (+ 479us) server_negotiation.cc:407] Connection header received
0811 01:31:49.037399 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.037402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.037483 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.037633 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:49.038212 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.038939 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.040320 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.040738 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.040835 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.041242 (+ 407us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.041950 (+ 708us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.042063 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.042255 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.042371 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":249,"threads_started":1}
I20260811 01:31:49.051273 32762 raft_consensus.cc:1261] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Refusing update from remote peer 5abd60c77937424a80c98925c2041918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:49.051347 32595 raft_consensus.cc:1261] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Refusing update from remote peer 5abd60c77937424a80c98925c2041918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:49.052413 391 consensus_queue.cc:1035] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.052736 395 consensus_queue.cc:1035] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.068125 406 mvcc.cc:205] Tried to move back new op lower bound from 7317143179462742016 to 7317143179214495744. Current Snapshot: MvccSnapshot[applied={T|T < 7317143179462742016}]
I20260811 01:31:49.085201 32261 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:49.085505 32261 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:49.089931 32261 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Sending DeleteTablet for 3 replicas of tablet e832022df36343bdae85a0e32aca3917
I20260811 01:31:49.091612 32415 tablet_service.cc:1514] Processing DeleteTablet for tablet e832022df36343bdae85a0e32aca3917 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57648
I20260811 01:31:49.091887 32575 tablet_service.cc:1514] Processing DeleteTablet for tablet e832022df36343bdae85a0e32aca3917 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 01:31:49.091876 32736 tablet_service.cc:1514] Processing DeleteTablet for tablet e832022df36343bdae85a0e32aca3917 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:41188
I20260811 01:31:49.094965 32261 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:49.095748 32261 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:49.104619 418 tablet_replica.cc:330] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: stopping tablet replica
I20260811 01:31:49.106593 418 raft_consensus.cc:2229] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:49.107244 418 raft_consensus.cc:2258] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.110069 32414 tablet_service.cc:1467] Processing CreateTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 (DEFAULT_TABLE table=test-table [id=4235780856d04c17a4f4059ea6e4799b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.110957 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3657cd74bb94f5cb01d5d4c92337108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.112344 417 tablet_replica.cc:330] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: stopping tablet replica
I20260811 01:31:49.112859 417 raft_consensus.cc:2229] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:49.113404 417 raft_consensus.cc:2258] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.115720 32574 tablet_service.cc:1467] Processing CreateTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 (DEFAULT_TABLE table=test-table [id=4235780856d04c17a4f4059ea6e4799b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.116320 32574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3657cd74bb94f5cb01d5d4c92337108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.116976 32736 tablet_service.cc:1467] Processing CreateTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 (DEFAULT_TABLE table=test-table [id=4235780856d04c17a4f4059ea6e4799b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.117488 32736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3657cd74bb94f5cb01d5d4c92337108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.122665 418 ts_tablet_manager.cc:1905] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.140774 417 ts_tablet_manager.cc:1905] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.144680 416 tablet_replica.cc:330] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: stopping tablet replica
I20260811 01:31:49.145244 416 raft_consensus.cc:2229] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:49.146144 416 raft_consensus.cc:2258] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.148723 416 ts_tablet_manager.cc:1905] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.150750 423 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Bootstrap starting.
I20260811 01:31:49.152848 423 tablet_bootstrap.cc:654] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.155623 420 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Bootstrap starting.
I20260811 01:31:49.148336 418 ts_tablet_manager.cc:1918] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:49.156446 418 log.cc:1196] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/e832022df36343bdae85a0e32aca3917
I20260811 01:31:49.157110 418 ts_tablet_manager.cc:1939] T e832022df36343bdae85a0e32aca3917 P e60ffd2c22c64da19d4a0733c92880e7: Deleting consensus metadata
I20260811 01:31:49.159744 416 ts_tablet_manager.cc:1918] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:49.159955 416 log.cc:1196] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/e832022df36343bdae85a0e32aca3917
I20260811 01:31:49.160604 416 ts_tablet_manager.cc:1939] T e832022df36343bdae85a0e32aca3917 P 5abd60c77937424a80c98925c2041918: Deleting consensus metadata
I20260811 01:31:49.161502 420 tablet_bootstrap.cc:654] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.162950 421 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Bootstrap starting.
I20260811 01:31:49.163434 32244 catalog_manager.cc:4841] TS e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281): tablet e832022df36343bdae85a0e32aca3917 (table test-table [id=b89e1f1f3e28407c806fc657dcff110c]) successfully deleted
I20260811 01:31:49.164755 32247 catalog_manager.cc:4841] TS 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659): tablet e832022df36343bdae85a0e32aca3917 (table test-table [id=b89e1f1f3e28407c806fc657dcff110c]) successfully deleted
I20260811 01:31:49.165270 421 tablet_bootstrap.cc:654] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.165277 423 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: No bootstrap required, opened a new log
I20260811 01:31:49.165513 423 ts_tablet_manager.cc:1397] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260811 01:31:49.166460 423 raft_consensus.cc:348] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.166735 423 raft_consensus.cc:374] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.166858 423 raft_consensus.cc:729] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.167124 423 consensus_queue.cc:260] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.167740 423 ts_tablet_manager.cc:1428] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 01:31:49.170288 417 ts_tablet_manager.cc:1918] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:49.170539 417 log.cc:1196] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/e832022df36343bdae85a0e32aca3917
I20260811 01:31:49.171219 417 ts_tablet_manager.cc:1939] T e832022df36343bdae85a0e32aca3917 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting consensus metadata
I20260811 01:31:49.173763 32244 catalog_manager.cc:4841] TS 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057): tablet e832022df36343bdae85a0e32aca3917 (table test-table [id=b89e1f1f3e28407c806fc657dcff110c]) successfully deleted
I20260811 01:31:49.175880 421 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: No bootstrap required, opened a new log
I20260811 01:31:49.176110 421 ts_tablet_manager.cc:1397] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260811 01:31:49.176564 420 tablet_bootstrap.cc:492] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: No bootstrap required, opened a new log
I20260811 01:31:49.176734 420 ts_tablet_manager.cc:1397] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.004s
I20260811 01:31:49.177068 421 raft_consensus.cc:348] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.177320 421 raft_consensus.cc:374] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.177428 421 raft_consensus.cc:729] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abd60c77937424a80c98925c2041918, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.177613 420 raft_consensus.cc:348] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.177888 420 raft_consensus.cc:374] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.177731 421 consensus_queue.cc:260] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.178006 420 raft_consensus.cc:729] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.178474 421 ts_tablet_manager.cc:1428] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 01:31:49.178294 420 consensus_queue.cc:260] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.178915 420 ts_tablet_manager.cc:1428] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:31:49.215842 405 raft_consensus.cc:482] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:49.216122 405 raft_consensus.cc:504] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.217864 405 leader_election.cc:288] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:49.230665 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.219974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56147 (local address 127.23.39.195:39057)
0811 01:31:49.220232 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.220241 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.223947 (+ 3706us) server_negotiation.cc:407] Connection header received
0811 01:31:49.224154 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.224161 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.224249 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.224302 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:49.225133 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.226325 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.228627 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.229535 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.229750 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.229836 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.230187 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.230355 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 01:31:49.230727 428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.218861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:39057 (local address 127.23.39.194:56147)
0811 01:31:49.223808 (+ 4947us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.223833 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.223974 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.224487 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.224489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.224512 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:49.224955 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.224967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.226490 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.226495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.228449 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.228460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.229750 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.229757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.229959 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.230006 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.230106 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.230371 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4761,"thread_start_us":4507,"threads_started":1}
I20260811 01:31:49.230851 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.219365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:44957 (local address 127.23.39.193:34659)
0811 01:31:49.219773 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.219783 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.223422 (+ 3639us) server_negotiation.cc:407] Connection header received
0811 01:31:49.223812 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.223823 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.223922 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.224013 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:49.224659 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.225626 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.228167 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.229574 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.229770 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.229851 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.230414 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.230571 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209}
I20260811 01:31:49.231550 427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.218152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:34659 (local address 127.23.39.194:44957)
0811 01:31:49.223295 (+ 5143us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.223318 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.223577 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.224064 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.224069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.224100 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:49.224442 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.224454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.225783 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.225790 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.227968 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.227983 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.230011 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.230016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.230219 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.230250 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.231038 (+ 788us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.231207 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4962,"thread_start_us":4775,"threads_started":1}
I20260811 01:31:49.231884 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3657cd74bb94f5cb01d5d4c92337108" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" is_pre_election: true
I20260811 01:31:49.232199 32762 raft_consensus.cc:2454] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 0.
I20260811 01:31:49.232760 32518 leader_election.cc:302] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:49.232679 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3657cd74bb94f5cb01d5d4c92337108" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918" is_pre_election: true
I20260811 01:31:49.233229 405 raft_consensus.cc:2781] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:49.233217 32441 raft_consensus.cc:2454] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 0.
I20260811 01:31:49.233361 405 raft_consensus.cc:482] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:49.233448 405 raft_consensus.cc:3037] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.236837 405 raft_consensus.cc:504] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.237629 405 leader_election.cc:288] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:49.238202 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3657cd74bb94f5cb01d5d4c92337108" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918"
I20260811 01:31:49.238257 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3657cd74bb94f5cb01d5d4c92337108" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
I20260811 01:31:49.238442 32441 raft_consensus.cc:3037] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.238500 32762 raft_consensus.cc:3037] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.240664 32762 raft_consensus.cc:2454] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 1.
I20260811 01:31:49.241173 32518 leader_election.cc:302] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:49.241488 405 raft_consensus.cc:2781] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:49.241905 32441 raft_consensus.cc:2454] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 1.
I20260811 01:31:49.242074 405 raft_consensus.cc:686] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 LEADER]: Becoming Leader. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Running, Role: LEADER
I20260811 01:31:49.242864 405 consensus_queue.cc:237] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.246899 32262 catalog_manager.cc:5495] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "e60ffd2c22c64da19d4a0733c92880e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } health_report { overall_health: UNKNOWN } } }
Aug 11 01:31:49 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411905, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.254@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:49.302577 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.284960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:36145 (local address 127.0.0.1:45178)
0811 01:31:49.285692 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.285715 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.285893 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.286484 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.286492 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.287482 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:49.287834 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.287849 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.289342 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.289348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.291015 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.291037 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.291784 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.291791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.292072 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.292836 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:49.292862 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:49.295895 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:49.299349 (+ 3454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:49.299368 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:49.299376 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:49.300016 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:49.300429 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:49.300434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:49.300438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:49.300627 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:49.301312 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:49.301323 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:49.301539 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.301754 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.302085 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":45,"thread_start_us":366,"threads_started":1}
I20260811 01:31:49.302672 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.284981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.23.39.254:36145)
0811 01:31:49.286099 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.286103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.286167 (+ 64us) server_negotiation.cc:407] Connection header received
0811 01:31:49.286235 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.286239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.286313 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.286408 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:49.288141 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.289170 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.291167 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.291603 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.291704 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.296158 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:49.296163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:49.296166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:49.296197 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:49.299185 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:49.300158 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:49.300163 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:49.300165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:49.300314 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:49.300768 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:49.300772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:49.300775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:49.301163 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:49.301301 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.301855 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.302292 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":213,"server-negotiator.queue_time_us":1029,"thread_start_us":831,"threads_started":1}
I20260811 01:31:49.308774 32262 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:45178:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 01:31:49.310197 32262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:49.318732 32414 tablet_service.cc:1467] Processing CreateTablet for tablet 5d58ed8336fc4c41bb70e506f9c9a013 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f5ffe90c7a4fc3adf89abc79ea9a65]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:31:49.318758 32574 tablet_service.cc:1467] Processing CreateTablet for tablet 5d58ed8336fc4c41bb70e506f9c9a013 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f5ffe90c7a4fc3adf89abc79ea9a65]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:31:49.319360 32574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d58ed8336fc4c41bb70e506f9c9a013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.319150 32736 tablet_service.cc:1467] Processing CreateTablet for tablet 5d58ed8336fc4c41bb70e506f9c9a013 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94f5ffe90c7a4fc3adf89abc79ea9a65]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 01:31:49.319370 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d58ed8336fc4c41bb70e506f9c9a013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.319754 32736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d58ed8336fc4c41bb70e506f9c9a013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.327617 421 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: Bootstrap starting.
I20260811 01:31:49.327857 423 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: Bootstrap starting.
I20260811 01:31:49.329211 421 tablet_bootstrap.cc:654] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.329602 423 tablet_bootstrap.cc:654] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.330754 420 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Bootstrap starting.
I20260811 01:31:49.332536 420 tablet_bootstrap.cc:654] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:49.332617 421 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: No bootstrap required, opened a new log
I20260811 01:31:49.332825 421 ts_tablet_manager.cc:1397] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260811 01:31:49.333756 423 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: No bootstrap required, opened a new log
I20260811 01:31:49.333714 421 raft_consensus.cc:348] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.333930 423 ts_tablet_manager.cc:1397] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260811 01:31:49.334159 421 raft_consensus.cc:374] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.334314 421 raft_consensus.cc:729] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abd60c77937424a80c98925c2041918, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.334677 421 consensus_queue.cc:260] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.334770 423 raft_consensus.cc:348] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.335048 423 raft_consensus.cc:374] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.335336 411 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.335747 411 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.335134 423 raft_consensus.cc:729] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.336045 423 consensus_queue.cc:260] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.336484 405 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.336771 405 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.337251 423 ts_tablet_manager.cc:1428] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:31:49.337914 421 ts_tablet_manager.cc:1428] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260811 01:31:49.348280 420 tablet_bootstrap.cc:492] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: No bootstrap required, opened a new log
I20260811 01:31:49.348519 420 ts_tablet_manager.cc:1397] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.002s
I20260811 01:31:49.349228 420 raft_consensus.cc:348] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.349493 420 raft_consensus.cc:374] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:49.349577 420 raft_consensus.cc:729] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Initialized, Role: FOLLOWER
I20260811 01:31:49.349937 420 consensus_queue.cc:260] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.350447 404 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.350863 404 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.353308 420 ts_tablet_manager.cc:1428] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 01:31:49.595112 411 raft_consensus.cc:482] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:49.595388 411 raft_consensus.cc:504] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.596067 411 leader_election.cc:288] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:49.596855 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d58ed8336fc4c41bb70e506f9c9a013" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7" is_pre_election: true
I20260811 01:31:49.596922 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d58ed8336fc4c41bb70e506f9c9a013" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" is_pre_election: true
I20260811 01:31:49.597134 32595 raft_consensus.cc:2454] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 0.
I20260811 01:31:49.597240 32762 raft_consensus.cc:2454] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 0.
I20260811 01:31:49.597607 32356 leader_election.cc:302] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abd60c77937424a80c98925c2041918, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:49.597954 411 raft_consensus.cc:2781] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:49.598098 411 raft_consensus.cc:482] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:49.598215 411 raft_consensus.cc:3037] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.601394 411 raft_consensus.cc:504] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.602097 411 leader_election.cc:288] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 election: Requested vote from peers e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:49.602779 32595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d58ed8336fc4c41bb70e506f9c9a013" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7"
I20260811 01:31:49.602864 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d58ed8336fc4c41bb70e506f9c9a013" candidate_uuid: "5abd60c77937424a80c98925c2041918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
I20260811 01:31:49.603073 32595 raft_consensus.cc:3037] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.603119 32762 raft_consensus.cc:3037] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:49.606297 32595 raft_consensus.cc:2454] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 1.
I20260811 01:31:49.606282 32762 raft_consensus.cc:2454] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abd60c77937424a80c98925c2041918 in term 1.
I20260811 01:31:49.606869 32356 leader_election.cc:302] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, 5abd60c77937424a80c98925c2041918; no voters:
I20260811 01:31:49.607245 411 raft_consensus.cc:2781] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:49.607707 411 raft_consensus.cc:686] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [term 1 LEADER]: Becoming Leader. State: Replica: 5abd60c77937424a80c98925c2041918, State: Running, Role: LEADER
I20260811 01:31:49.608063 411 consensus_queue.cc:237] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:49.609840 445 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: TxnStatusTablet state changed. Reason: New leader 5abd60c77937424a80c98925c2041918. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.610306 445 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:31:49.611137 448 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 01:31:49.611375 448 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 01:31:49.611555 32260 catalog_manager.cc:5495] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5abd60c77937424a80c98925c2041918 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } health_report { overall_health: UNKNOWN } } }
I20260811 01:31:49.652571 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.647171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:34659 (local address 127.0.0.1:57660)
0811 01:31:49.647424 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.647450 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.647603 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.648061 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.648066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.648078 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:31:49.648285 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.648294 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.649362 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.649370 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.650452 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.650465 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.651224 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.651238 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.651441 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.651505 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.651940 (+ 435us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.651968 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.652071 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.652250 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 01:31:49.652549 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.647180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57660 (local address 127.23.39.193:34659)
0811 01:31:49.647575 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.647581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.647602 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:31:49.647826 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.647839 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.647926 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.648026 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:49.648430 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.649222 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.650592 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.651066 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.651212 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.651698 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.651826 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.651941 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.652100 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.652191 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260811 01:31:49.657490 32762 raft_consensus.cc:1261] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Refusing update from remote peer 5abd60c77937424a80c98925c2041918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:49.657549 32595 raft_consensus.cc:1261] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Refusing update from remote peer 5abd60c77937424a80c98925c2041918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:49.658270 445 consensus_queue.cc:1035] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.658612 411 consensus_queue.cc:1035] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.671841 404 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: TxnStatusTablet state changed. Reason: New leader 5abd60c77937424a80c98925c2041918. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.672196 404 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.673198 405 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: TxnStatusTablet state changed. Reason: New leader 5abd60c77937424a80c98925c2041918. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.673506 405 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.675711 452 mvcc.cc:205] Tried to move back new op lower bound from 7317143181949775872 to 7317143181757353984. Current Snapshot: MvccSnapshot[applied={T|T < 7317143181949775872}]
I20260811 01:31:49.676000 451 mvcc.cc:205] Tried to move back new op lower bound from 7317143181949775872 to 7317143181757353984. Current Snapshot: MvccSnapshot[applied={T|T < 7317143181949775872}]
I20260811 01:31:49.677697 405 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.677984 405 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P e60ffd2c22c64da19d4a0733c92880e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.686086 411 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.686431 411 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:31:49.686730 411 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.687001 411 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 5abd60c77937424a80c98925c2041918: This TxnStatusTablet replica's current role is: LEADER
I20260811 01:31:49.688076 404 tablet_replica.cc:439] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5abd60c77937424a80c98925c2041918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } } }
I20260811 01:31:49.688367 404 tablet_replica.cc:442] T 5d58ed8336fc4c41bb70e506f9c9a013 P 4fcf7925b7764ed1981fe8ddf5f67a3f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 01:31:49.691183 405 consensus_queue.cc:1035] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.702284 429 consensus_queue.cc:1035] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:49.720520 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.711357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51452 (local address 127.23.39.194:46281)
0811 01:31:49.714645 (+ 3288us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.714650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.714668 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:31:49.714763 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.714767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.714856 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.715057 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:49.715583 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.716394 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.717826 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.718363 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.718500 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.719001 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.719682 (+ 681us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.719848 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.719944 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.720033 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3147,"thread_start_us":3004,"threads_started":1}
I20260811 01:31:49.738281 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.732822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:51237 (local address 127.23.39.193:34659)
0811 01:31:49.733023 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.733030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.733261 (+ 231us) server_negotiation.cc:407] Connection header received
0811 01:31:49.733490 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.733498 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.733576 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.733682 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:49.734118 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.734934 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.736338 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.736810 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.736947 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.737417 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.737555 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.737660 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.737820 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.737906 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:31:49.738335 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.732690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:34659 (local address 127.23.39.194:51237)
0811 01:31:49.733159 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.733180 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.733346 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.733702 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.733707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.733719 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:31:49.733954 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.733963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.735089 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.735095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.736174 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.736187 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.736974 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.736980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.737139 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.737197 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.737662 (+ 465us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.737685 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.737793 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.737944 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":338,"threads_started":1}
I20260811 01:31:49.786739 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.779279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:41811 (local address 127.23.39.194:46281)
0811 01:31:49.779470 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.779475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.780295 (+ 820us) server_negotiation.cc:407] Connection header received
0811 01:31:49.780652 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.780658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.780744 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.780848 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:49.781867 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.782873 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.784584 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.785133 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.785277 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.785897 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.786044 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.786160 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.786309 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.786405 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:31:49.787019 472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.779291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46281 (local address 127.23.39.193:41811)
0811 01:31:49.780161 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:49.780201 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:49.780486 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:49.781052 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:49.781057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:49.781071 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 01:31:49.781654 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.781672 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.783013 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.783018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.784439 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:49.784453 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.785368 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.785375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:49.785560 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.785661 (+ 101us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 01:31:49.786167 (+ 506us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 01:31:49.786183 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 01:31:49.786272 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:31:49.786435 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":485,"threads_started":1}
I20260811 01:31:49.830892 32260 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:49.831241 32260 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:49.835212 32260 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Sending DeleteTablet for 3 replicas of tablet b3657cd74bb94f5cb01d5d4c92337108
I20260811 01:31:49.836347 32414 tablet_service.cc:1514] Processing DeleteTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57648
I20260811 01:31:49.836624 32736 tablet_service.cc:1514] Processing DeleteTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:41188
I20260811 01:31:49.837574 32574 tablet_service.cc:1514] Processing DeleteTablet for tablet b3657cd74bb94f5cb01d5d4c92337108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:49 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 01:31:49.846290 479 tablet_replica.cc:330] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: stopping tablet replica
I20260811 01:31:49.847255 479 raft_consensus.cc:2229] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:49.851115 479 raft_consensus.cc:2258] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.853215 479 ts_tablet_manager.cc:1905] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.854342 478 tablet_replica.cc:330] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: stopping tablet replica
I20260811 01:31:49.854696 478 raft_consensus.cc:2229] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:49.855017 480 tablet_replica.cc:330] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: stopping tablet replica
I20260811 01:31:49.855151 478 raft_consensus.cc:2258] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.855270 480 raft_consensus.cc:2229] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:49.855880 480 raft_consensus.cc:2258] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:49.863011 480 ts_tablet_manager.cc:1905] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.863957 478 ts_tablet_manager.cc:1905] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:49.871802 478 ts_tablet_manager.cc:1918] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:49.872002 478 log.cc:1196] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/b3657cd74bb94f5cb01d5d4c92337108
I20260811 01:31:49.872581 478 ts_tablet_manager.cc:1939] T b3657cd74bb94f5cb01d5d4c92337108 P 5abd60c77937424a80c98925c2041918: Deleting consensus metadata
I20260811 01:31:49.874550 479 ts_tablet_manager.cc:1918] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:49.874740 479 log.cc:1196] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/b3657cd74bb94f5cb01d5d4c92337108
I20260811 01:31:49.875347 479 ts_tablet_manager.cc:1939] T b3657cd74bb94f5cb01d5d4c92337108 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting consensus metadata
I20260811 01:31:49.876816 32244 catalog_manager.cc:4841] TS 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057): tablet b3657cd74bb94f5cb01d5d4c92337108 (table test-table [id=4235780856d04c17a4f4059ea6e4799b]) successfully deleted
I20260811 01:31:49.877658 32247 catalog_manager.cc:4841] TS 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659): tablet b3657cd74bb94f5cb01d5d4c92337108 (table test-table [id=4235780856d04c17a4f4059ea6e4799b]) successfully deleted
I20260811 01:31:49.887099 480 ts_tablet_manager.cc:1918] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:49.887359 480 log.cc:1196] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/b3657cd74bb94f5cb01d5d4c92337108
I20260811 01:31:49.888077 480 ts_tablet_manager.cc:1939] T b3657cd74bb94f5cb01d5d4c92337108 P e60ffd2c22c64da19d4a0733c92880e7: Deleting consensus metadata
I20260811 01:31:49.889751 32244 catalog_manager.cc:4841] TS e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281): tablet b3657cd74bb94f5cb01d5d4c92337108 (table test-table [id=4235780856d04c17a4f4059ea6e4799b]) successfully deleted
Aug 11 01:31:49 dist-test-slave-9jjr krb5kdc[32211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 01:31:49 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:31:49 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:31:49.954826 489 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:49.928767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.23.39.254:36145)
0811 01:31:49.935495 (+ 6728us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.935503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.935532 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:31:49.935622 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.935630 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.935724 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.935868 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:49.937812 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.939279 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.941293 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.942051 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.942308 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.954352 (+ 12044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45186: BlockingRecv error: recv got EOF from 127.0.0.1:45186 (error 108)
Metrics: {"server-negotiator.queue_time_us":6535,"thread_start_us":6599,"threads_started":1}
Aug 11 01:31:49 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM
I20260811 01:31:49.977509 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:49.956783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.23.39.254:36145)
0811 01:31:49.956986 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:49.956994 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:49.957597 (+ 603us) server_negotiation.cc:407] Connection header received
0811 01:31:49.957751 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:49.957757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:49.957856 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:49.957976 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:49.959788 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.961253 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.963565 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:49.964400 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:49.964543 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:49.970089 (+ 5546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:49.970098 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:49.970104 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:49.970201 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:49.973949 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:49.974995 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:49.975003 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:49.975006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:49.975207 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:49.975722 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:49.975727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:49.975730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:49.976165 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:49.976485 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:49.976831 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 01:31:49.977106 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:31:49.982093 32260 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:49.982884 32260 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:49.992095 32574 tablet_service.cc:1467] Processing CreateTablet for tablet d115d72322bc46a5a05e5938d331ee50 (DEFAULT_TABLE table=test-table [id=b1ef1263837d429ea35435c7e636368b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.992690 32574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d115d72322bc46a5a05e5938d331ee50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.996732 32736 tablet_service.cc:1467] Processing CreateTablet for tablet d115d72322bc46a5a05e5938d331ee50 (DEFAULT_TABLE table=test-table [id=b1ef1263837d429ea35435c7e636368b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.997082 32414 tablet_service.cc:1467] Processing CreateTablet for tablet d115d72322bc46a5a05e5938d331ee50 (DEFAULT_TABLE table=test-table [id=b1ef1263837d429ea35435c7e636368b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:49.997313 32736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d115d72322bc46a5a05e5938d331ee50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:49.997608 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d115d72322bc46a5a05e5938d331ee50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:50.018754 495 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Bootstrap starting.
I20260811 01:31:50.021313 495 tablet_bootstrap.cc:654] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.028877 497 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Bootstrap starting.
I20260811 01:31:50.031410 497 tablet_bootstrap.cc:654] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.035123 496 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Bootstrap starting.
I20260811 01:31:50.035984 495 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: No bootstrap required, opened a new log
I20260811 01:31:50.036183 495 ts_tablet_manager.cc:1397] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20260811 01:31:50.037133 496 tablet_bootstrap.cc:654] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.037159 495 raft_consensus.cc:348] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.037460 495 raft_consensus.cc:374] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.037568 495 raft_consensus.cc:729] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abd60c77937424a80c98925c2041918, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.037897 495 consensus_queue.cc:260] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.039757 495 ts_tablet_manager.cc:1428] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 01:31:50.041412 496 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: No bootstrap required, opened a new log
I20260811 01:31:50.041591 496 ts_tablet_manager.cc:1397] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260811 01:31:50.042474 496 raft_consensus.cc:348] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.042744 496 raft_consensus.cc:374] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.042852 496 raft_consensus.cc:729] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.043236 496 consensus_queue.cc:260] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.044896 496 ts_tablet_manager.cc:1428] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 01:31:50.047835 497 tablet_bootstrap.cc:492] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: No bootstrap required, opened a new log
I20260811 01:31:50.048031 497 ts_tablet_manager.cc:1397] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.006s
I20260811 01:31:50.048915 497 raft_consensus.cc:348] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.049190 497 raft_consensus.cc:374] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.049290 497 raft_consensus.cc:729] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.049551 497 consensus_queue.cc:260] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.050236 497 ts_tablet_manager.cc:1428] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 01:31:50.086522 404 raft_consensus.cc:482] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:50.086783 404 raft_consensus.cc:504] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.088652 404 leader_election.cc:288] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281)
I20260811 01:31:50.111096 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.089966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:45771 (local address 127.23.39.193:34659)
0811 01:31:50.090426 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.090435 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.101699 (+ 11264us) server_negotiation.cc:407] Connection header received
0811 01:31:50.102481 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.102491 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.102615 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.102699 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:50.103783 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.105073 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.108224 (+ 3151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.109713 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.109872 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.109967 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.110561 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.110734 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262}
I20260811 01:31:50.112336 504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.088838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:34659 (local address 127.23.39.195:45771)
0811 01:31:50.101518 (+ 12680us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:50.101552 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:50.102217 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:50.102987 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:50.102995 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:50.103032 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:50.103529 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:50.103546 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.105282 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.105290 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:50.108016 (+ 2726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:50.108028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.110153 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.110160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:50.110346 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.110388 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:31:50.111699 (+ 1311us) client_negotiation.cc:240] Negotiation successful
0811 01:31:50.111890 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12455,"thread_start_us":16187,"threads_started":1}
I20260811 01:31:50.112980 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.090625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46797 (local address 127.23.39.194:46281)
0811 01:31:50.090894 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.090902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.105005 (+ 14103us) server_negotiation.cc:407] Connection header received
0811 01:31:50.105513 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.105520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.105651 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.105726 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:31:50.106580 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.107702 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.110174 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.111589 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.111727 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.111800 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.112470 (+ 670us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.112636 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:31:50.113564 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d115d72322bc46a5a05e5938d331ee50" candidate_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918" is_pre_election: true
I20260811 01:31:50.113910 32441 raft_consensus.cc:2454] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fcf7925b7764ed1981fe8ddf5f67a3f in term 0.
I20260811 01:31:50.114060 503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.089470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46281 (local address 127.23.39.195:46797)
0811 01:31:50.104883 (+ 15413us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:50.104904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:50.105311 (+ 407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:50.105929 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:50.105939 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:50.105965 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:31:50.106394 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:50.106409 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.107901 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.107907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:50.109942 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:50.109958 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.112003 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.112012 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:50.112217 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.112262 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 01:31:50.113449 (+ 1187us) client_negotiation.cc:240] Negotiation successful
0811 01:31:50.113644 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15279,"thread_start_us":12266,"threads_started":1}
I20260811 01:31:50.114681 32681 leader_election.cc:302] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, 5abd60c77937424a80c98925c2041918; no voters:
I20260811 01:31:50.115557 404 raft_consensus.cc:2781] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:50.115454 32594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d115d72322bc46a5a05e5938d331ee50" candidate_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7" is_pre_election: true
I20260811 01:31:50.115716 404 raft_consensus.cc:482] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:50.115808 404 raft_consensus.cc:3037] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.115844 32594 raft_consensus.cc:2454] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fcf7925b7764ed1981fe8ddf5f67a3f in term 0.
I20260811 01:31:50.118964 404 raft_consensus.cc:504] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.120276 32594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d115d72322bc46a5a05e5938d331ee50" candidate_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60ffd2c22c64da19d4a0733c92880e7"
I20260811 01:31:50.120308 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d115d72322bc46a5a05e5938d331ee50" candidate_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918"
I20260811 01:31:50.120433 404 leader_election.cc:288] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [CANDIDATE]: Term 1 election: Requested vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281)
I20260811 01:31:50.120568 32594 raft_consensus.cc:3037] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.120599 32441 raft_consensus.cc:3037] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.124107 32441 raft_consensus.cc:2454] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fcf7925b7764ed1981fe8ddf5f67a3f in term 1.
I20260811 01:31:50.124127 32594 raft_consensus.cc:2454] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fcf7925b7764ed1981fe8ddf5f67a3f in term 1.
I20260811 01:31:50.124647 32681 leader_election.cc:302] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, 5abd60c77937424a80c98925c2041918; no voters:
I20260811 01:31:50.125535 404 raft_consensus.cc:2781] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:50.126413 404 raft_consensus.cc:686] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 LEADER]: Becoming Leader. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Running, Role: LEADER
I20260811 01:31:50.126854 404 consensus_queue.cc:237] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.137053 32260 catalog_manager.cc:5495] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195). New cstate: current_term: 1 leader_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } health_report { overall_health: HEALTHY } } }
I20260811 01:31:50.160501 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.151574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41196 (local address 127.23.39.195:39057)
0811 01:31:50.152898 (+ 1324us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.152905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.152930 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:50.153050 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.153055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.153168 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.153377 (+ 209us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:50.153900 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.155134 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.157123 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.157835 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.157969 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.158680 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:50.159527 (+ 847us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:50.159695 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.159803 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.159899 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1173,"thread_start_us":974,"threads_started":1}
I20260811 01:31:50.164963 32594 raft_consensus.cc:1261] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Refusing update from remote peer 4fcf7925b7764ed1981fe8ddf5f67a3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:50.165750 32441 raft_consensus.cc:1261] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Refusing update from remote peer 4fcf7925b7764ed1981fe8ddf5f67a3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:50.165851 505 consensus_queue.cc:1035] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:50.166564 404 consensus_queue.cc:1035] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:50.201484 32262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:50.201768 32262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:50.205319 32262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Sending DeleteTablet for 3 replicas of tablet d115d72322bc46a5a05e5938d331ee50
I20260811 01:31:50.206156 32414 tablet_service.cc:1514] Processing DeleteTablet for tablet d115d72322bc46a5a05e5938d331ee50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57648
I20260811 01:31:50.206542 478 tablet_replica.cc:330] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: stopping tablet replica
I20260811 01:31:50.206790 478 raft_consensus.cc:2229] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:50.207047 478 raft_consensus.cc:2258] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.207038 32574 tablet_service.cc:1514] Processing DeleteTablet for tablet d115d72322bc46a5a05e5938d331ee50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 01:31:50.207357 480 tablet_replica.cc:330] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: stopping tablet replica
I20260811 01:31:50.207569 480 raft_consensus.cc:2229] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:50.207664 32736 tablet_service.cc:1514] Processing DeleteTablet for tablet d115d72322bc46a5a05e5938d331ee50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:41188
I20260811 01:31:50.207818 480 raft_consensus.cc:2258] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.208101 479 tablet_replica.cc:330] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: stopping tablet replica
I20260811 01:31:50.208318 479 raft_consensus.cc:2229] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:50.208395 478 ts_tablet_manager.cc:1905] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.208894 479 raft_consensus.cc:2258] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.209652 32260 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:31:50.210441 32260 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:31:50.212596 479 ts_tablet_manager.cc:1905] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.215435 478 ts_tablet_manager.cc:1918] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:50.215612 478 log.cc:1196] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/d115d72322bc46a5a05e5938d331ee50
I20260811 01:31:50.216071 478 ts_tablet_manager.cc:1939] T d115d72322bc46a5a05e5938d331ee50 P 5abd60c77937424a80c98925c2041918: Deleting consensus metadata
I20260811 01:31:50.217499 32247 catalog_manager.cc:4841] TS 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659): tablet d115d72322bc46a5a05e5938d331ee50 (table test-table [id=b1ef1263837d429ea35435c7e636368b]) successfully deleted
I20260811 01:31:50.218248 480 ts_tablet_manager.cc:1905] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.225533 480 ts_tablet_manager.cc:1918] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:50.225725 480 log.cc:1196] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/d115d72322bc46a5a05e5938d331ee50
I20260811 01:31:50.226300 480 ts_tablet_manager.cc:1939] T d115d72322bc46a5a05e5938d331ee50 P e60ffd2c22c64da19d4a0733c92880e7: Deleting consensus metadata
I20260811 01:31:50.227453 32574 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4bc7d50024a16ad864a4da573648c (DEFAULT_TABLE table=test-table [id=fce885495a9f4a92aa88961b4f532485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:50.227928 32574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4bc7d50024a16ad864a4da573648c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:50.231053 32736 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4bc7d50024a16ad864a4da573648c (DEFAULT_TABLE table=test-table [id=fce885495a9f4a92aa88961b4f532485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:50.231564 32736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4bc7d50024a16ad864a4da573648c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:50.234346 32244 catalog_manager.cc:4841] TS e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281): tablet d115d72322bc46a5a05e5938d331ee50 (table test-table [id=b1ef1263837d429ea35435c7e636368b]) successfully deleted
I20260811 01:31:50.235450 32414 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4bc7d50024a16ad864a4da573648c (DEFAULT_TABLE table=test-table [id=fce885495a9f4a92aa88961b4f532485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:31:50.235903 32414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4bc7d50024a16ad864a4da573648c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:50.261485 496 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Bootstrap starting.
I20260811 01:31:50.263542 496 tablet_bootstrap.cc:654] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.263852 497 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Bootstrap starting.
I20260811 01:31:50.265493 479 ts_tablet_manager.cc:1918] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:31:50.265695 479 log.cc:1196] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/d115d72322bc46a5a05e5938d331ee50
I20260811 01:31:50.265833 497 tablet_bootstrap.cc:654] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.266249 479 ts_tablet_manager.cc:1939] T d115d72322bc46a5a05e5938d331ee50 P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting consensus metadata
I20260811 01:31:50.267078 495 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Bootstrap starting.
I20260811 01:31:50.267549 32244 catalog_manager.cc:4841] TS 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057): tablet d115d72322bc46a5a05e5938d331ee50 (table test-table [id=b1ef1263837d429ea35435c7e636368b]) successfully deleted
I20260811 01:31:50.268883 495 tablet_bootstrap.cc:654] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:50.269166 496 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: No bootstrap required, opened a new log
I20260811 01:31:50.269403 496 ts_tablet_manager.cc:1397] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260811 01:31:50.270514 496 raft_consensus.cc:348] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.270812 496 raft_consensus.cc:374] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.270902 496 raft_consensus.cc:729] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fcf7925b7764ed1981fe8ddf5f67a3f, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.271238 496 consensus_queue.cc:260] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.276309 496 ts_tablet_manager.cc:1428] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 01:31:50.280125 497 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: No bootstrap required, opened a new log
I20260811 01:31:50.280393 497 ts_tablet_manager.cc:1397] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260811 01:31:50.281430 497 raft_consensus.cc:348] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.281744 497 raft_consensus.cc:374] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.281859 497 raft_consensus.cc:729] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.282308 497 consensus_queue.cc:260] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.283339 495 tablet_bootstrap.cc:492] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: No bootstrap required, opened a new log
I20260811 01:31:50.283548 495 ts_tablet_manager.cc:1397] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.015s
I20260811 01:31:50.284433 495 raft_consensus.cc:348] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.284746 495 raft_consensus.cc:374] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:50.284845 495 raft_consensus.cc:729] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abd60c77937424a80c98925c2041918, State: Initialized, Role: FOLLOWER
I20260811 01:31:50.285146 495 consensus_queue.cc:260] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.285892 495 ts_tablet_manager.cc:1428] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 01:31:50.287053 497 ts_tablet_manager.cc:1428] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260811 01:31:50.317224 473 raft_consensus.cc:482] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:31:50.317495 473 raft_consensus.cc:504] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.318394 473 leader_election.cc:288] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:50.319089 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4bc7d50024a16ad864a4da573648c" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918" is_pre_election: true
I20260811 01:31:50.319181 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4bc7d50024a16ad864a4da573648c" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" is_pre_election: true
I20260811 01:31:50.319398 32441 raft_consensus.cc:2454] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 0.
I20260811 01:31:50.319492 32762 raft_consensus.cc:2454] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 0.
I20260811 01:31:50.320086 32518 leader_election.cc:302] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:50.320483 473 raft_consensus.cc:2781] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:31:50.320631 473 raft_consensus.cc:482] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:31:50.320729 473 raft_consensus.cc:3037] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.324285 473 raft_consensus.cc:504] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.325664 32762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4bc7d50024a16ad864a4da573648c" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f"
I20260811 01:31:50.325974 32762 raft_consensus.cc:3037] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.326165 32441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4bc7d50024a16ad864a4da573648c" candidate_uuid: "e60ffd2c22c64da19d4a0733c92880e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abd60c77937424a80c98925c2041918"
I20260811 01:31:50.326439 32441 raft_consensus.cc:3037] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:50.329584 32762 raft_consensus.cc:2454] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 1.
I20260811 01:31:50.329905 32441 raft_consensus.cc:2454] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60ffd2c22c64da19d4a0733c92880e7 in term 1.
I20260811 01:31:50.330339 32518 leader_election.cc:302] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fcf7925b7764ed1981fe8ddf5f67a3f, e60ffd2c22c64da19d4a0733c92880e7; no voters:
I20260811 01:31:50.331091 473 leader_election.cc:288] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [CANDIDATE]: Term 1 election: Requested vote from peers 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659), 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057)
I20260811 01:31:50.331409 473 raft_consensus.cc:2781] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:50.331604 473 raft_consensus.cc:686] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 1 LEADER]: Becoming Leader. State: Replica: e60ffd2c22c64da19d4a0733c92880e7, State: Running, Role: LEADER
I20260811 01:31:50.331990 473 consensus_queue.cc:237] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } }
I20260811 01:31:50.343268 32260 catalog_manager.cc:5495] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "e60ffd2c22c64da19d4a0733c92880e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60ffd2c22c64da19d4a0733c92880e7" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 } health_report { overall_health: UNKNOWN } } }
I20260811 01:31:50.388433 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.380536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51466 (local address 127.23.39.194:46281)
0811 01:31:50.380762 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.380768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.380786 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:31:50.380862 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.380867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.380956 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.381047 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:31:50.381782 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.383051 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.385589 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.386370 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.386515 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.387218 (+ 703us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:31:50.387371 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:31:50.387456 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.388026 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.388119 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:31:50.406580 32762 raft_consensus.cc:1261] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Refusing update from remote peer e60ffd2c22c64da19d4a0733c92880e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:50.407343 32441 raft_consensus.cc:1261] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Refusing update from remote peer e60ffd2c22c64da19d4a0733c92880e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:31:50.407780 520 consensus_queue.cc:1035] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fcf7925b7764ed1981fe8ddf5f67a3f" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 39057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:50.409162 473 consensus_queue.cc:1035] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5abd60c77937424a80c98925c2041918" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:31:50.501106 32260 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:50.501387 32260 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:31:50.505311 32260 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72734e294240497cbd0a6489595dda92: Sending DeleteTablet for 3 replicas of tablet 50c4bc7d50024a16ad864a4da573648c
I20260811 01:31:50.506368 32414 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c4bc7d50024a16ad864a4da573648c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57648
I20260811 01:31:50.506706 478 tablet_replica.cc:330] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: stopping tablet replica
I20260811 01:31:50.506917 478 raft_consensus.cc:2229] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:50.507143 478 raft_consensus.cc:2258] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.507462 32736 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c4bc7d50024a16ad864a4da573648c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:41188
I20260811 01:31:50.507828 479 tablet_replica.cc:330] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: stopping tablet replica
I20260811 01:31:50.508044 479 raft_consensus.cc:2229] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:31:50.507990 32574 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c4bc7d50024a16ad864a4da573648c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:31:50 UTC) from {username='oryx', principal='oryx/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51438
I20260811 01:31:50.508270 479 raft_consensus.cc:2258] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.508323 480 tablet_replica.cc:330] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: stopping tablet replica
I20260811 01:31:50.508517 480 raft_consensus.cc:2229] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:31:50.508922 480 raft_consensus.cc:2258] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:31:50.509291 479 ts_tablet_manager.cc:1905] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.510488 480 ts_tablet_manager.cc:1905] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.516387 479 ts_tablet_manager.cc:1918] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:50.516566 479 log.cc:1196] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/50c4bc7d50024a16ad864a4da573648c
I20260811 01:31:50.516539 478 ts_tablet_manager.cc:1905] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:31:50.517033 479 ts_tablet_manager.cc:1939] T 50c4bc7d50024a16ad864a4da573648c P 4fcf7925b7764ed1981fe8ddf5f67a3f: Deleting consensus metadata
I20260811 01:31:50.518349 32244 catalog_manager.cc:4841] TS 4fcf7925b7764ed1981fe8ddf5f67a3f (127.23.39.195:39057): tablet 50c4bc7d50024a16ad864a4da573648c (table test-table [id=fce885495a9f4a92aa88961b4f532485]) successfully deleted
I20260811 01:31:50.523880 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 32339
I20260811 01:31:50.524592 480 ts_tablet_manager.cc:1918] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:50.524801 480 log.cc:1196] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/50c4bc7d50024a16ad864a4da573648c
I20260811 01:31:50.525346 480 ts_tablet_manager.cc:1939] T 50c4bc7d50024a16ad864a4da573648c P e60ffd2c22c64da19d4a0733c92880e7: Deleting consensus metadata
I20260811 01:31:50.527014 478 ts_tablet_manager.cc:1918] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 01:31:50.526947 32244 catalog_manager.cc:4841] TS e60ffd2c22c64da19d4a0733c92880e7 (127.23.39.194:46281): tablet 50c4bc7d50024a16ad864a4da573648c (table test-table [id=fce885495a9f4a92aa88961b4f532485]) successfully deleted
I20260811 01:31:50.527298 478 log.cc:1196] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/50c4bc7d50024a16ad864a4da573648c
I20260811 01:31:50.527791 478 ts_tablet_manager.cc:1939] T 50c4bc7d50024a16ad864a4da573648c P 5abd60c77937424a80c98925c2041918: Deleting consensus metadata
I20260811 01:31:50.528996 32247 catalog_manager.cc:4841] TS 5abd60c77937424a80c98925c2041918 (127.23.39.193:34659): tablet 50c4bc7d50024a16ad864a4da573648c (table test-table [id=fce885495a9f4a92aa88961b4f532485]) successfully deleted
Aug 11 01:31:50 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.193@KRBTEST.COM
I20260811 01:31:50.549333 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.524916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57666 (local address 127.23.39.193:34659)
0811 01:31:50.525107 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.525114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.527824 (+ 2710us) server_negotiation.cc:407] Connection header received
0811 01:31:50.528080 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.528085 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.528165 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.528292 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:50.529887 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.530718 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.532053 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.532488 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.532642 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.541490 (+ 8848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:50.541509 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:50.541524 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:50.541572 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:50.545467 (+ 3895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.546723 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.546734 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.546738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.546966 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.547493 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.547498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.547503 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.548034 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:50.548364 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.548662 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.548952 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:31:50.550071 32490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:50.755805 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 32339
I20260811 01:31:50.790633 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 32500
Aug 11 01:31:50 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.194@KRBTEST.COM
I20260811 01:31:50.806522 465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.791526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51468 (local address 127.23.39.194:46281)
0811 01:31:50.791734 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.791738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.791757 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:31:50.791885 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.791889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.791954 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.792050 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:50.793275 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.794042 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.795438 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.795853 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.795956 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.800473 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:50.800491 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:50.800507 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:50.800555 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:50.803553 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.804363 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.804371 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.804373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.804525 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.804927 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.804931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.804934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.805403 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:50.805675 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.805963 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.806239 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:31:50.807277 32646 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:50.941250 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 32500
I20260811 01:31:50.970822 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 32657
Aug 11 01:31:50 dist-test-slave-9jjr krb5kdc[32211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.39.195@KRBTEST.COM
I20260811 01:31:50.987627 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:50.971677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41210 (local address 127.23.39.195:39057)
0811 01:31:50.972155 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:50.972159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:50.972175 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:31:50.972231 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:50.972235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:50.972297 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:50.972427 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:50.973845 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.974607 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.976016 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:50.976450 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:50.976589 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:50.981426 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:50.981445 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:50.981462 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:50.981504 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:50.984497 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.985294 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.985302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.985304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.985450 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:50.985879 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:50.985885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:50.985888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:50.986347 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:50.986686 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:50.986985 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 01:31:50.987281 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":242,"threads_started":1}
I20260811 01:31:50.988480 345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:51.118054 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 32657
I20260811 01:31:51.146467 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 32226
I20260811 01:31:51.147758 32308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:51.270046 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 32226
2026-08-11T01:31:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7890 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:51 dist-test-slave-9jjr krb5kdc[541](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:51 dist-test-slave-9jjr krb5kdc[541](info): set up 2 sockets
Aug 11 01:31:51 dist-test-slave-9jjr krb5kdc[541](info): commencing operation
krb5kdc: starting...
W20260811 01:31:52.473490 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:52 dist-test-slave-9jjr krb5kdc[541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:52.789805 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42099
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:53.148319 556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:53.148636 556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:53.148797 556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:53.156373 556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:53.156500 556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:53.156595 556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:53.156703 556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:53.156787 556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:53.167277 556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:53.168713 556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:53.170166 556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:53.183429 564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:53.183506 562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:53.183465 561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:53.183811 556 server_base.cc:1034] running on GCE node
I20260811 01:31:53.185031 556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:53.186671 556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:53.187922 556 hybrid_clock.cc:648] HybridClock initialized: now 1786411913187879 us; error 44 us; skew 500 ppm
I20260811 01:31:53.188299 556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T01:31:53Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1980 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:31:53 dist-test-slave-9jjr krb5kdc[570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:31:53 dist-test-slave-9jjr krb5kdc[570](info): set up 2 sockets
Aug 11 01:31:53 dist-test-slave-9jjr krb5kdc[570](info): commencing operation
krb5kdc: starting...
W20260811 01:31:54.460686 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.002s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:31:54 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:31:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:31:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:31:54.764175 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45135
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:45135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:55.123523 586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:55.123839 586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:55.123930 586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:55.131309 586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:55.131434 586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:55.131481 586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:55.131532 586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:55.131578 586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:55.141656 586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:45135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:55.143041 586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:55.144399 586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:55.156629 591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:55.156718 592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:55.156673 594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:55.157994 586 server_base.cc:1034] running on GCE node
I20260811 01:31:55.158960 586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:55.160552 586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:55.161800 586 hybrid_clock.cc:648] HybridClock initialized: now 1786411915161760 us; error 39 us; skew 500 ppm
I20260811 01:31:55.162287 586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:55 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411915, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:55.165745 586 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:55.167620 586 webserver.cc:460] Webserver started at http://127.23.39.254:36405/ using document root <none> and password file <none>
I20260811 01:31:55.168383 586 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:55.168536 586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:55.168886 586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:55.172154 586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b1944933e14b45eea004346153b7733f"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "770f76a6715393cf0b471c8183ebc1e5"
server_key_iv: "60ec2ad2289f42c3daf0e3422e49f824"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.172998 586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b1944933e14b45eea004346153b7733f"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "770f76a6715393cf0b471c8183ebc1e5"
server_key_iv: "60ec2ad2289f42c3daf0e3422e49f824"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.178782 586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:31:55.182560 602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:55.184070 586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:31:55.184281 586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b1944933e14b45eea004346153b7733f"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "770f76a6715393cf0b471c8183ebc1e5"
server_key_iv: "60ec2ad2289f42c3daf0e3422e49f824"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.184506 586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:55.200793 586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:55.206604 586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:55.206979 586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:55.225838 586 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:45135
I20260811 01:31:55.225876 661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:45135 every 8 connection(s)
I20260811 01:31:55.227504 586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:55.231568 662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:31:55.237892 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 586
I20260811 01:31:55.238233 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:31:55.238927 23711 external_mini_cluster.cc:1428] Setting key 5d255c8c5b79b9e5216d36aba9c1ebcf
I20260811 01:31:55.243084 662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Bootstrap starting.
I20260811 01:31:55.247278 662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Neither blocks nor log segments found. Creating new log.
I20260811 01:31:55.248468 662 log.cc:824] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:55.252103 662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: No bootstrap required, opened a new log
Aug 11 01:31:55 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:55.263396 662 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:55.263947 662 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:31:55.264086 662 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1944933e14b45eea004346153b7733f, State: Initialized, Role: FOLLOWER
I20260811 01:31:55.264853 662 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:55.265200 662 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:55.265395 662 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:55.265604 662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:31:55.266824 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:55.241128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.23.39.254:45135)
0811 01:31:55.241970 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:55.241983 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:55.242037 (+ 54us) server_negotiation.cc:407] Connection header received
0811 01:31:55.244057 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:55.244083 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:55.244501 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:55.244865 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:55.247190 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.248690 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.250502 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.251329 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.251497 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:55.256700 (+ 5203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:55.256713 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:55.256745 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:55.256798 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:55.261221 (+ 4423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:55.262048 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:55.262058 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:55.262068 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:55.262352 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:55.263102 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:55.263107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:55.263110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:55.263970 (+ 860us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:55.264309 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:55.264887 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 01:31:55.265489 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":400,"threads_started":1}
I20260811 01:31:55.268883 662 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:55.269474 662 leader_election.cc:302] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1944933e14b45eea004346153b7733f; no voters:
I20260811 01:31:55.270200 662 leader_election.cc:288] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:31:55.270401 667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:31:55.271190 667 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 LEADER]: Becoming Leader. State: Replica: b1944933e14b45eea004346153b7733f, State: Running, Role: LEADER
I20260811 01:31:55.271864 667 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:55.272652 662 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:55.275518 668 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1944933e14b45eea004346153b7733f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } } }
I20260811 01:31:55.276028 668 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:55.275535 669 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1944933e14b45eea004346153b7733f. Latest consensus state: current_term: 1 leader_uuid: "b1944933e14b45eea004346153b7733f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } } }
I20260811 01:31:55.278605 669 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:55.279263 675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:55.286422 675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:55.297075 675 catalog_manager.cc:1347] Generated new cluster ID: 913692e48dcc480a858f72ebe972a214
I20260811 01:31:55.297241 675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:55.322633 675 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:31:55.324796 675 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:55.340081 675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Generated new TSK 0
I20260811 01:31:55.341307 675 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:31:55.419961 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:55.788714 691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:55.789076 691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:55.789180 691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:55.797165 691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:55.797320 691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:55.797441 691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:55.808058 691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:55.809487 691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:55.811033 691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:55.826170 697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:55.826193 700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:55.826152 698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:55.827181 691 server_base.cc:1034] running on GCE node
I20260811 01:31:55.827958 691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:55.829077 691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:55.830305 691 hybrid_clock.cc:648] HybridClock initialized: now 1786411915830261 us; error 69 us; skew 500 ppm
I20260811 01:31:55.830657 691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:55 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411915, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:55.839943 691 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:31:55.841979 691 webserver.cc:460] Webserver started at http://127.23.39.193:40617/ using document root <none> and password file <none>
I20260811 01:31:55.842854 691 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:55.843024 691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:55.843391 691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:55.846891 691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "abd8d20d3d0e4a8188684fabfa125cd8"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "10d330ad7f17a07284bd4ff7725f243b"
server_key_iv: "521e97a3f984381d94c74b8772c7f90d"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.847821 691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "abd8d20d3d0e4a8188684fabfa125cd8"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "10d330ad7f17a07284bd4ff7725f243b"
server_key_iv: "521e97a3f984381d94c74b8772c7f90d"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.854287 691 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:31:55.858686 709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:55.860350 691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:31:55.860582 691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "abd8d20d3d0e4a8188684fabfa125cd8"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "10d330ad7f17a07284bd4ff7725f243b"
server_key_iv: "521e97a3f984381d94c74b8772c7f90d"
server_key_version: "encryptionkey@0"
I20260811 01:31:55.860854 691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:55.879474 691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:55.884485 691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:55.884768 691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:55.885907 691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:55.887799 691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:55.887940 691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:55.888129 691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:55.888193 691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:55.925340 691 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33121
I20260811 01:31:55.925388 833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33121 every 8 connection(s)
I20260811 01:31:55.926776 691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:55.932745 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 691
I20260811 01:31:55.932979 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:31:55.933665 23711 external_mini_cluster.cc:1428] Setting key 3af91a87553d8a58ae9765dd58750e11
Aug 11 01:31:55 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411915, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:55.951855 836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:55.929620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60859 (local address 127.23.39.254:45135)
0811 01:31:55.930299 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:55.930303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:55.931255 (+ 952us) server_negotiation.cc:407] Connection header received
0811 01:31:55.933312 (+ 2057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:55.933319 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:55.933425 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:55.933553 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:55.935964 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.937076 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.938929 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.939695 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.939851 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:55.943853 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:55.943862 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:55.943870 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:55.943923 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:55.947701 (+ 3778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:55.948959 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:55.948964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:55.948966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:55.949103 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:55.949721 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:55.949726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:55.949728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:55.950049 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:55.950292 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:55.951371 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0811 01:31:55.951592 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":286,"threads_started":1}
I20260811 01:31:55.954027 837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:55.930299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:60859)
0811 01:31:55.931067 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:55.931109 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:55.932953 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:55.933884 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:55.933894 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:55.934649 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:55.935392 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:55.935411 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.937273 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.937277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:55.938743 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:55.938757 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:55.939930 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:55.939935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:55.940161 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:55.940931 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:55.940957 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:55.943544 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:55.947912 (+ 4368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:55.947920 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:55.947936 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:55.948760 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:55.949229 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:55.949234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:55.949237 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:55.949544 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:55.950288 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:55.950299 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:55.950862 (+ 563us) client_negotiation.cc:769] Sending connection context
0811 01:31:55.951203 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 01:31:55.951880 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":296,"threads_started":1}
I20260811 01:31:55.955924 834 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45135
I20260811 01:31:55.956297 834 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:55.957108 834 heartbeater.cc:511] Master 127.23.39.254:45135 requested a full tablet report, sending...
I20260811 01:31:55.959504 625 ts_manager.cc:194] Registered new tserver with Master: abd8d20d3d0e4a8188684fabfa125cd8 (127.23.39.193:33121)
I20260811 01:31:55.961098 625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:60859
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:31:56.004037 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:56.362352 840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:56.362713 840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:56.362882 840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:56.370827 840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:56.371002 840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:56.371174 840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:56.381794 840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:56.383291 840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:56.384749 840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:56.398988 846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:56.398958 847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:56.398914 849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:56.399899 840 server_base.cc:1034] running on GCE node
I20260811 01:31:56.400604 840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:56.401665 840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:56.402906 840 hybrid_clock.cc:648] HybridClock initialized: now 1786411916402851 us; error 50 us; skew 500 ppm
I20260811 01:31:56.403270 840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:56 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411916, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:56.406733 840 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:31:56.408304 840 webserver.cc:460] Webserver started at http://127.23.39.194:44749/ using document root <none> and password file <none>
I20260811 01:31:56.409046 840 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:56.409155 840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:56.409478 840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:56.412860 840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "3e67e41b839546c59531f806d08c12dc"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "13062ad6de69883ef57403773fee32b5"
server_key_iv: "21e6101558928e6e5a03e80741c1d36a"
server_key_version: "encryptionkey@0"
I20260811 01:31:56.413928 840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "3e67e41b839546c59531f806d08c12dc"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "13062ad6de69883ef57403773fee32b5"
server_key_iv: "21e6101558928e6e5a03e80741c1d36a"
server_key_version: "encryptionkey@0"
I20260811 01:31:56.419966 840 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260811 01:31:56.424135 856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:56.425741 840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:31:56.425951 840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "3e67e41b839546c59531f806d08c12dc"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "13062ad6de69883ef57403773fee32b5"
server_key_iv: "21e6101558928e6e5a03e80741c1d36a"
server_key_version: "encryptionkey@0"
I20260811 01:31:56.426292 840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:56.455742 840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:56.460363 840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:56.460700 840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:56.461843 840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:56.463380 840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:56.463490 840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:56.463644 840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:56.463716 840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:56.499625 840 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35157
I20260811 01:31:56.499644 992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35157 every 8 connection(s)
I20260811 01:31:56.501111 840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:56.506316 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 840
I20260811 01:31:56.506517 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:31:56.506989 23711 external_mini_cluster.cc:1428] Setting key 392c00fcf443a214df5e295d15c4189f
Aug 11 01:31:56 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411916, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:56.525063 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:56.503862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:45635 (local address 127.23.39.254:45135)
0811 01:31:56.504335 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:56.504342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:56.505419 (+ 1077us) server_negotiation.cc:407] Connection header received
0811 01:31:56.507558 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:56.507565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:56.507655 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:56.507760 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:56.509839 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:56.511004 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:56.512631 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:56.513363 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:56.513511 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:56.517408 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:56.517418 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:56.517426 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:56.517478 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:56.521314 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:56.522453 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:56.522457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:56.522459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:56.522602 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:56.523187 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:56.523190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:56.523196 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:56.523481 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:56.523596 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:56.524581 (+ 985us) server_negotiation.cc:299] Negotiation successful
0811 01:31:56.524784 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":211,"threads_started":1}
I20260811 01:31:56.526795 996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:56.504499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:45635)
0811 01:31:56.505236 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:56.505284 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:56.507247 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:56.508034 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:56.508043 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:56.508875 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:56.509651 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:56.509670 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:56.511169 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:56.511173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:56.512472 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:56.512485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:56.513582 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:56.513587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:56.513797 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:56.514577 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:56.514601 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:56.517122 (+ 2521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:56.521506 (+ 4384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:56.521514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:56.521530 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:56.522314 (+ 784us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:56.522723 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:56.522730 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:56.522735 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:56.523040 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:56.523618 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:56.523630 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:56.524151 (+ 521us) client_negotiation.cc:769] Sending connection context
0811 01:31:56.524467 (+ 316us) client_negotiation.cc:240] Negotiation successful
0811 01:31:56.525110 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":292,"threads_started":1}
I20260811 01:31:56.528453 993 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45135
I20260811 01:31:56.528796 993 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:56.529561 993 heartbeater.cc:511] Master 127.23.39.254:45135 requested a full tablet report, sending...
I20260811 01:31:56.531426 625 ts_manager.cc:194] Registered new tserver with Master: 3e67e41b839546c59531f806d08c12dc (127.23.39.194:35157)
I20260811 01:31:56.532346 625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:45635
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:31:56.577999 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:56.945377 999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:56.945690 999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:56.945885 999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:56.953554 999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:56.953725 999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:56.953931 999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:56.964671 834 heartbeater.cc:503] Master 127.23.39.254:45135 was elected leader, sending a full tablet report...
I20260811 01:31:56.964556 999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:56.966059 999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:56.967686 999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:56.981760 1005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:56.981820 1008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:56.981784 1006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:56.982717 999 server_base.cc:1034] running on GCE node
I20260811 01:31:56.983523 999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:56.984583 999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:56.985827 999 hybrid_clock.cc:648] HybridClock initialized: now 1786411916985769 us; error 54 us; skew 500 ppm
I20260811 01:31:56.986276 999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:56 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411916, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:56.989894 999 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:31:56.991660 999 webserver.cc:460] Webserver started at http://127.23.39.195:41279/ using document root <none> and password file <none>
I20260811 01:31:56.992445 999 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:56.992607 999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:56.992959 999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:31:56.996308 999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "93b37e3aabe144449a3a07609ce31608"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "30886800143c37bffa26f251da79d36d"
server_key_iv: "1f38187e1ae075236a7b6730afebf517"
server_key_version: "encryptionkey@0"
I20260811 01:31:56.997171 999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "93b37e3aabe144449a3a07609ce31608"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "30886800143c37bffa26f251da79d36d"
server_key_iv: "1f38187e1ae075236a7b6730afebf517"
server_key_version: "encryptionkey@0"
I20260811 01:31:57.002856 999 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:31:57.006808 1016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:57.008353 999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:31:57.008579 999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "93b37e3aabe144449a3a07609ce31608"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "30886800143c37bffa26f251da79d36d"
server_key_iv: "1f38187e1ae075236a7b6730afebf517"
server_key_version: "encryptionkey@0"
I20260811 01:31:57.008831 999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:57.024786 999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:57.029862 999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:57.030265 999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:57.031445 999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:57.032933 999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:57.033042 999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:57.033203 999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:57.033291 999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:57.069607 999 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:39365
I20260811 01:31:57.069646 1150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:39365 every 8 connection(s)
I20260811 01:31:57.071080 999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:31:57.075600 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 999
I20260811 01:31:57.075812 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:31:57.076392 23711 external_mini_cluster.cc:1428] Setting key 1aa2422a3e161d95d00cd87bf053f947
Aug 11 01:31:57 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411916, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:31:57.093909 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:57.074003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46129 (local address 127.23.39.254:45135)
0811 01:31:57.074567 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:57.074572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:57.075820 (+ 1248us) server_negotiation.cc:407] Connection header received
0811 01:31:57.077919 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:57.077924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:57.078015 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:57.078191 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:57.080284 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.081089 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.082747 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.083163 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.083287 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:57.087010 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:57.087015 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:57.087019 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:57.087058 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:57.090195 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.091202 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.091207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.091209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.091409 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.091933 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.091960 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.091965 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.092350 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:57.092513 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:57.093375 (+ 862us) server_negotiation.cc:299] Negotiation successful
0811 01:31:57.093595 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":317,"threads_started":1}
I20260811 01:31:57.095041 1154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:57.074490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:46129)
0811 01:31:57.075293 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:57.075370 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:57.077594 (+ 2224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:57.078432 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:57.078441 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:57.079254 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:57.080117 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:57.080139 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.081252 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.081256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:57.082609 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:57.082622 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.083403 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.083408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:57.083604 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:57.084291 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:57.084315 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:31:57.086740 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:31:57.090397 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:57.090405 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:57.090421 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:57.091041 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:57.091545 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:31:57.091549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:31:57.091551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:31:57.091797 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:31:57.092497 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:31:57.092512 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:31:57.092983 (+ 471us) client_negotiation.cc:769] Sending connection context
0811 01:31:57.093255 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 01:31:57.093774 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":301,"threads_started":1}
I20260811 01:31:57.096825 1151 heartbeater.cc:347] Connected to a master server at 127.23.39.254:45135
I20260811 01:31:57.097186 1151 heartbeater.cc:464] Registering TS with master...
I20260811 01:31:57.098004 1151 heartbeater.cc:511] Master 127.23.39.254:45135 requested a full tablet report, sending...
I20260811 01:31:57.099843 625 ts_manager.cc:194] Registered new tserver with Master: 93b37e3aabe144449a3a07609ce31608 (127.23.39.195:39365)
I20260811 01:31:57.100723 625 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:46129
I20260811 01:31:57.105472 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
Entry for principal oryx/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab.
WARNING: no policy specified for oryx/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
Entry for principal oryx/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab.
WARNING: no policy specified for oryx/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
Entry for principal oryx/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab.
I20260811 01:31:57.301615 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 691
Aug 11 01:31:57 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:31:57.321339 1167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:57.303198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48312 (local address 127.23.39.193:33121)
0811 01:31:57.303940 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:57.303948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:57.303979 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:31:57.304048 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:57.304055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:57.304288 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:57.304448 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:57.306034 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.307260 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.308649 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.309330 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.309468 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:57.314654 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:57.314673 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:57.314690 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:57.314735 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:57.317994 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.318946 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.318955 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.318957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.319153 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.319727 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.319733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.319743 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.320163 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:57.320425 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:57.320769 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 01:31:57.321009 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":388,"threads_started":1}
I20260811 01:31:57.322870 828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:57.410425 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 691
I20260811 01:31:57.431530 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 840
Aug 11 01:31:57 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:31:57.448832 1171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:57.432551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58982 (local address 127.23.39.194:35157)
0811 01:31:57.433104 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:57.433111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:57.433136 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:31:57.433196 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:57.433203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:57.433430 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:57.433605 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:57.435216 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.436279 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.437592 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.438247 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.438385 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:57.442823 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:57.442836 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:57.442851 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:57.442890 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:57.445732 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.446581 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.446590 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.446593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.446724 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.447138 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.447142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.447145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.447511 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:57.447849 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:57.448176 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 01:31:57.448472 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":279,"threads_started":1}
I20260811 01:31:57.450515 988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:57.535579 993 heartbeater.cc:503] Master 127.23.39.254:45135 was elected leader, sending a full tablet report...
I20260811 01:31:57.538291 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 840
I20260811 01:31:57.558329 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 999
Aug 11 01:31:57 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:31:57.576555 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:57.559472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43702 (local address 127.23.39.195:39365)
0811 01:31:57.560070 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:57.560077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:57.560108 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:31:57.560169 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:57.560176 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:57.560384 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:57.560507 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:57.561829 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.563023 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.564307 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:57.564868 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:57.564963 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:57.569640 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:31:57.569651 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:31:57.569666 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:31:57.569700 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:31:57.572629 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.573743 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.573776 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.573779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.573977 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:31:57.574505 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:31:57.574511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:31:57.574515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:31:57.575075 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:31:57.575416 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 01:31:57.575820 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 01:31:57.576097 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":312,"threads_started":1}
I20260811 01:31:57.577901 1146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:57.663794 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 999
I20260811 01:31:57.684477 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 586
I20260811 01:31:57.685765 657 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:31:57.796053 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 586
I20260811 01:31:57.821537 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45135
--webserver_interface=127.23.39.254
--webserver_port=36405
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:45135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:31:58.182761 1176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:58.183109 1176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:58.183300 1176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:58.190757 1176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:31:58.190887 1176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:58.191007 1176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:58.191093 1176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:31:58.191174 1176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:31:58.201596 1176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:45135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=36405
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:58.203022 1176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:58.204401 1176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:58.216504 1183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:58.216508 1184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:58.216532 1187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:58.217767 1176 server_base.cc:1034] running on GCE node
I20260811 01:31:58.218715 1176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:58.220289 1176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:58.221539 1176 hybrid_clock.cc:648] HybridClock initialized: now 1786411918221531 us; error 118 us; skew 500 ppm
I20260811 01:31:58.221920 1176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:58 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411918, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:58.225291 1176 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:31:58.226972 1176 webserver.cc:460] Webserver started at http://127.23.39.254:36405/ using document root <none> and password file <none>
I20260811 01:31:58.227725 1176 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:58.227897 1176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:58.233693 1176 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 01:31:58.236852 1195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:58.238453 1176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:31:58.238667 1176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b1944933e14b45eea004346153b7733f"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "770f76a6715393cf0b471c8183ebc1e5"
server_key_iv: "60ec2ad2289f42c3daf0e3422e49f824"
server_key_version: "encryptionkey@0"
I20260811 01:31:58.239778 1176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:58.258287 1176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:58.262934 1176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:58.263217 1176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:58.284169 1176 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:45135
I20260811 01:31:58.284189 1255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:45135 every 8 connection(s)
I20260811 01:31:58.285950 1176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:31:58.293429 1256 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:31:58.293731 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1176
I20260811 01:31:58.294665 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:33121
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:45135
--webserver_port=40617
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:31:58.297102 1256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Bootstrap starting.
I20260811 01:31:58.321162 1256 log.cc:824] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:31:58.335029 1256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:31:58.335870 1256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Bootstrap complete.
I20260811 01:31:58.350980 1256 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:58.352249 1256 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1944933e14b45eea004346153b7733f, State: Initialized, Role: FOLLOWER
I20260811 01:31:58.353060 1256 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:58.353456 1256 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:31:58.353626 1256 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:31:58.353828 1256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:31:58.358228 1256 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:58.358829 1256 leader_election.cc:302] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1944933e14b45eea004346153b7733f; no voters:
I20260811 01:31:58.359552 1256 leader_election.cc:288] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:31:58.359702 1260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:31:58.361095 1260 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [term 2 LEADER]: Becoming Leader. State: Replica: b1944933e14b45eea004346153b7733f, State: Running, Role: LEADER
I20260811 01:31:58.361805 1260 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } }
I20260811 01:31:58.362017 1256 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:31:58.364637 1261 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b1944933e14b45eea004346153b7733f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } } }
I20260811 01:31:58.365124 1261 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:58.365739 1262 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1944933e14b45eea004346153b7733f. Latest consensus state: current_term: 2 leader_uuid: "b1944933e14b45eea004346153b7733f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1944933e14b45eea004346153b7733f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45135 } } }
I20260811 01:31:58.366212 1262 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f [sys.catalog]: This master's current role is: LEADER
I20260811 01:31:58.368424 1266 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:31:58.375629 1266 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:31:58.377203 1266 catalog_manager.cc:1259] Loaded cluster ID: 913692e48dcc480a858f72ebe972a214
I20260811 01:31:58.377308 1266 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:31:58.381345 1266 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:31:58.383014 1266 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1944933e14b45eea004346153b7733f: Loaded TSK: 0
I20260811 01:31:58.384867 1266 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:31:58.690834 1258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:58.691205 1258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:58.691377 1258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:58.699092 1258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:58.699265 1258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:58.699458 1258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:31:58.709703 1258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.193.keytab
--principal=oryx/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:33121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=40617
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:58.711265 1258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:58.712667 1258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:58.728173 1285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:58.728369 1286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:58.728945 1288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:58.729490 1258 server_base.cc:1034] running on GCE node
I20260811 01:31:58.730269 1258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:58.731413 1258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:58.732693 1258 hybrid_clock.cc:648] HybridClock initialized: now 1786411918732640 us; error 47 us; skew 500 ppm
I20260811 01:31:58.733068 1258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:58 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411918, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:58.736739 1258 init.cc:377] Logged in from keytab as oryx/127.23.39.193@KRBTEST.COM (short username oryx)
I20260811 01:31:58.738622 1258 webserver.cc:460] Webserver started at http://127.23.39.193:40617/ using document root <none> and password file <none>
I20260811 01:31:58.739396 1258 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:58.739557 1258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:58.745605 1258 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 01:31:58.748602 1297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:58.750170 1258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 01:31:58.750387 1258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "abd8d20d3d0e4a8188684fabfa125cd8"
format_stamp: "Formatted at 2026-08-11 01:31:55 on dist-test-slave-9jjr"
server_key: "10d330ad7f17a07284bd4ff7725f243b"
server_key_iv: "521e97a3f984381d94c74b8772c7f90d"
server_key_version: "encryptionkey@0"
I20260811 01:31:58.751473 1258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:58.768095 1258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:58.773036 1258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:58.773343 1258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:58.774485 1258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:58.775964 1258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:58.776057 1258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:58.776206 1258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:58.776296 1258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:58.812635 1258 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33121
I20260811 01:31:58.812752 1430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33121 every 8 connection(s)
I20260811 01:31:58.814224 1258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:31:58.823755 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1258
I20260811 01:31:58.824430 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:35157
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:45135
--webserver_port=44749
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:31:58 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:31:58 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:31:59.205369 1435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:59.205685 1435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:59.205842 1435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:59.213799 1435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:59.213929 1435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:59.214181 1435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:31:59.224537 1435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.194.keytab
--principal=oryx/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:35157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=44749
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:59.225975 1435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:59.227398 1435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:59.241948 1443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:59.242013 1444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:59.242484 1446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:59.243538 1435 server_base.cc:1034] running on GCE node
I20260811 01:31:59.244259 1435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:59.245445 1435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:59.248865 1435 hybrid_clock.cc:648] HybridClock initialized: now 1786411919248771 us; error 87 us; skew 500 ppm
I20260811 01:31:59.249306 1435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:59 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411919, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:59.253042 1435 init.cc:377] Logged in from keytab as oryx/127.23.39.194@KRBTEST.COM (short username oryx)
I20260811 01:31:59.255252 1435 webserver.cc:460] Webserver started at http://127.23.39.194:44749/ using document root <none> and password file <none>
I20260811 01:31:59.256179 1435 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:59.256407 1435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:59.263000 1435 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:31:59.266345 1457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:59.268298 1435 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:31:59.268507 1435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "3e67e41b839546c59531f806d08c12dc"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "13062ad6de69883ef57403773fee32b5"
server_key_iv: "21e6101558928e6e5a03e80741c1d36a"
server_key_version: "encryptionkey@0"
I20260811 01:31:59.269556 1435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:59.295359 1435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:59.300606 1435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:59.300940 1435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:59.302173 1435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:59.303791 1435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:59.303922 1435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:59.304067 1435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:59.304162 1435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:59.353334 1435 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35157
I20260811 01:31:59.353396 1585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35157 every 8 connection(s)
I20260811 01:31:59.355079 1435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:31:59.359721 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1435
I20260811 01:31:59.360466 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:39365
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:45135
--webserver_port=41279
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:31:59 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:31:59 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 01:31:59.762699 1590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:31:59.763160 1590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:31:59.763343 1590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:31:59.771951 1590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:31:59.772137 1590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:31:59.772336 1590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:31:59.783469 1590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/krb5kdc/oryx_127.23.39.195.keytab
--principal=oryx/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:39365
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=41279
--tserver_master_addrs=127.23.39.254:45135
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:31:59.784961 1590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:31:59.786451 1590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:31:59.822758 1598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:31:59.824043 1599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:59.832618 1590 server_base.cc:1034] running on GCE node
W20260811 01:31:59.833374 1601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:31:59.834781 1590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:31:59.836793 1590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:31:59.838377 1590 hybrid_clock.cc:648] HybridClock initialized: now 1786411919838286 us; error 78 us; skew 500 ppm
I20260811 01:31:59.839033 1590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:31:59 dist-test-slave-9jjr krb5kdc[570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411919, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:31:59.846010 1590 init.cc:377] Logged in from keytab as oryx/127.23.39.195@KRBTEST.COM (short username oryx)
I20260811 01:31:59.849385 1590 webserver.cc:460] Webserver started at http://127.23.39.195:41279/ using document root <none> and password file <none>
I20260811 01:31:59.851003 1590 fs_manager.cc:359] Metadata directory not provided
I20260811 01:31:59.851256 1590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:31:59.864002 1590 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.007s sys 0.001s
I20260811 01:31:59.870354 1611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:59.873391 1590 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260811 01:31:59.873731 1590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "93b37e3aabe144449a3a07609ce31608"
format_stamp: "Formatted at 2026-08-11 01:31:56 on dist-test-slave-9jjr"
server_key: "30886800143c37bffa26f251da79d36d"
server_key_iv: "1f38187e1ae075236a7b6730afebf517"
server_key_version: "encryptionkey@0"
I20260811 01:31:59.876096 1590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:31:59.937235 1590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:31:59.947062 1590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:31:59.947576 1590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:31:59.949704 1590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:31:59.952958 1590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:31:59.953172 1590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:31:59.953377 1590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:31:59.953514 1590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:00.026754 1590 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:39365
I20260811 01:32:00.026844 1739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:39365 every 8 connection(s)
I20260811 01:32:00.029927 1590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:32:00.037827 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1590
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:00.084739 1745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.039025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35796 (local address 127.23.39.254:45135)
0811 01:32:00.052247 (+ 13222us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.052256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.052281 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:32:00.052362 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.052370 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.052485 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.052662 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.056287 (+ 3625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.058434 (+ 2147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.061496 (+ 3062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.062615 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.062799 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.068878 (+ 6079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:00.068896 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:00.068935 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:00.069020 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:00.075459 (+ 6439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:00.077149 (+ 1690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:00.077165 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:00.077184 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:00.077578 (+ 394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:00.078295 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:00.078303 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:00.078310 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:00.079353 (+ 1043us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:00.079872 (+ 519us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:00.082217 (+ 2345us) server_negotiation.cc:299] Negotiation successful
0811 01:32:00.083028 (+ 811us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12979,"thread_start_us":12769,"threads_started":1}
W20260811 01:32:00.261207 1434 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.431s user 0.005s sys 0.013s
W20260811 01:32:00.263847 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:58.817354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:55113 (local address 127.23.39.254:45135)
0811 01:31:58.818249 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:58.818266 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:58.818509 (+ 243us) server_negotiation.cc:407] Connection header received
0811 01:31:58.820705 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:58.820717 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:58.821055 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:58.821407 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:58.823121 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:58.824536 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:58.827396 (+ 2860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:58.828213 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:58.828383 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.263310 (+1434927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:55113: BlockingRecv error: recv got EOF from 127.23.39.193:55113 (error 108)
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":328,"threads_started":1}
I20260811 01:32:00.265079 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:58.817391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:55113)
0811 01:31:58.818313 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:58.818359 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:58.820118 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:58.821561 (+ 1443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:58.821574 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:58.822340 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:58.822902 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:58.822919 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:58.824789 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:58.824797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:58.827186 (+ 2389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:58.827211 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:58.828501 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:58.828511 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:58.828847 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:58.829702 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:58.829740 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.262682 (+1432942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":358,"threads_started":1}
W20260811 01:32:00.268266 1431 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:45135 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.39.254:45135: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:00.287858 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.269357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:56517)
0811 01:32:00.269866 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:00.269897 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:00.270174 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:00.270711 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:00.270719 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:00.271464 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:00.271799 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.271818 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.274202 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.274213 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.276615 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.276643 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.278591 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.278612 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.278915 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.280043 (+ 1128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:00.280082 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.287353 (+ 7271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290}
W20260811 01:32:00.289829 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:00.269795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:56517 (local address 127.23.39.254:45135)
0811 01:32:00.270071 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.270081 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.270110 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:32:00.270369 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.270377 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.270493 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.270663 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.272045 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.273809 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.276871 (+ 3062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.277957 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.278172 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.289403 (+ 11231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:56517: BlockingRecv error: recv got EOF from 127.23.39.193:56517 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:00.309083 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.289288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:60413)
0811 01:32:00.290699 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:00.290729 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:00.290983 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:00.291760 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:00.291768 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:00.292442 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:00.292788 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.292805 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.295208 (+ 2403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.295218 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.297645 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.297669 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.299852 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.299863 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.300183 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.301313 (+ 1130us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:00.301353 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.308584 (+ 7231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1220}
W20260811 01:32:00.309410 1433 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:00.290075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60413 (local address 127.23.39.254:45135)
0811 01:32:00.290437 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.290447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.290834 (+ 387us) server_negotiation.cc:407] Connection header received
0811 01:32:00.291186 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.291195 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.291310 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.291414 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.293051 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.294872 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.297895 (+ 3023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.299041 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.299208 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.308986 (+ 9778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:60413: BlockingRecv error: recv got EOF from 127.23.39.193:60413 (error 108)
Metrics: {"server-negotiator.queue_time_us":167}
W20260811 01:32:00.310070 1431 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:32:00.751721 1589 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.374s user 0.007s sys 0.014s
W20260811 01:32:00.753590 1588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:31:59.358188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:39735 (local address 127.23.39.254:45135)
0811 01:31:59.358768 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0811 01:31:59.358774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:31:59.362499 (+ 3725us) server_negotiation.cc:407] Connection header received
0811 01:31:59.364718 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:31:59.364727 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:31:59.364858 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:31:59.365001 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:31:59.368550 (+ 3549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:59.369846 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:59.374217 (+ 4371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:31:59.375356 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:31:59.375566 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.753276 (+1377710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:39735: BlockingRecv error: recv got EOF from 127.23.39.194:39735 (error 108)
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":274,"threads_started":1}
I20260811 01:32:00.754931 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:31:59.358775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:39735)
0811 01:31:59.359934 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 01:31:59.360009 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 01:31:59.364182 (+ 4173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:31:59.365463 (+ 1281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:31:59.365484 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:31:59.366807 (+ 1323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:31:59.368212 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:59.368264 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:59.370181 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:59.370190 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:59.373677 (+ 3487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:31:59.373708 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:31:59.376140 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:31:59.376152 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:31:59.376698 (+ 546us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:31:59.377943 (+ 1245us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:31:59.377994 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.753127 (+1375133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":401,"threads_started":1}
W20260811 01:32:00.756321 1586 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:45135 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.39.254:45135: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:00.769565 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.757282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:38305)
0811 01:32:00.757480 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:00.757502 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:00.757614 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:00.758105 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:00.758109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:00.758572 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:00.758769 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.758779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.760957 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.760961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.761960 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.761974 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.763512 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.763519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.763702 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.764618 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:00.764637 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.769241 (+ 4604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 01:32:00.770483 1588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:00.757399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:38305 (local address 127.23.39.254:45135)
0811 01:32:00.757666 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.757675 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.757708 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:32:00.757804 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.757813 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.757928 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.758108 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.758954 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.760744 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.762171 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.763263 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.763452 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.769666 (+ 6214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:38305: BlockingRecv error: recv got EOF from 127.23.39.194:38305 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:00 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:00.784098 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.770565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:48153)
0811 01:32:00.770926 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:00.770946 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:00.771050 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:00.771488 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:00.771492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:00.771797 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:00.771964 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.771973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.774162 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.774169 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.775263 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.775277 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.777006 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.777016 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.777365 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.778456 (+ 1091us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:00.778493 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:00.783885 (+ 5392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233}
W20260811 01:32:00.784612 1586 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:32:00.784785 1588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:00.770787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:48153 (local address 127.23.39.254:45135)
0811 01:32:00.771044 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.771053 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.771083 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:32:00.771177 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.771184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.771314 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.771466 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.772133 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.773941 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.775430 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.776485 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.776664 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.784356 (+ 7692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:48153: BlockingRecv error: recv got EOF from 127.23.39.194:48153 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 01:32:01.207958 1742 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.145s user 0.006s sys 0.013s
W20260811 01:32:01.209282 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:00.034793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:56577 (local address 127.23.39.254:45135)
0811 01:32:00.046670 (+ 11877us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:00.046680 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:00.046716 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:32:00.052107 (+ 5391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:00.052115 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:00.052233 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:00.052327 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:00.055862 (+ 3535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.057285 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.060019 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.060717 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.060813 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.208962 (+1148149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:56577: BlockingRecv error: recv got EOF from 127.23.39.195:56577 (error 108)
Metrics: {"server-negotiator.queue_time_us":11682,"spinlock_wait_cycles":15616,"thread_start_us":11516,"threads_started":1}
I20260811 01:32:01.209753 1742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:00.034031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:56577)
0811 01:32:00.042885 (+ 8854us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:00.042954 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:00.050986 (+ 8032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:00.053329 (+ 2343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:00.053347 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:00.054493 (+ 1146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:00.055571 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.055612 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.057608 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.057614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.059830 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:00.059847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:00.061214 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:00.061221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:00.061589 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:00.062556 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:00.062588 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:01.208763 (+1146175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":8476,"thread_start_us":8202,"threads_started":1}
W20260811 01:32:01.210757 1740 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:45135 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.39.254:45135: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:01.223826 1742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:01.211421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:54779)
0811 01:32:01.211607 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:01.211626 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:01.211753 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:01.212042 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:01.212045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:01.212393 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:01.212563 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.212571 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.213545 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.213548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.214585 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.214597 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.215442 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.215446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.215573 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.219496 (+ 3923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:01.219517 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:01.223485 (+ 3968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:32:01.223953 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:01.211471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:54779 (local address 127.23.39.254:45135)
0811 01:32:01.211637 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:01.211641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:01.211678 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:32:01.211855 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:01.211859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:01.211920 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:01.212001 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:01.212678 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.213428 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.214719 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.215125 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.215228 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.223702 (+ 8474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:54779: BlockingRecv error: recv got EOF from 127.23.39.195:54779 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:01.233577 1742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:01.224681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:58041)
0811 01:32:01.224864 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:01.224887 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:01.224997 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:01.225322 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:01.225325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:01.225613 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:01.225773 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.225782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.226841 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.226844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.227820 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.227831 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.228529 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.228534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.228666 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.229226 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:01.229243 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:01.233254 (+ 4011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:32:01.233770 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:01.224789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:58041 (local address 127.23.39.254:45135)
0811 01:32:01.225047 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:01.225052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:01.225067 (+ 15us) server_negotiation.cc:407] Connection header received
0811 01:32:01.225113 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:01.225116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:01.225185 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:01.225271 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:01.225898 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.226713 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.227944 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.228389 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.228480 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.233477 (+ 4997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:58041: BlockingRecv error: recv got EOF from 127.23.39.195:58041 (error 108)
Metrics: {"server-negotiator.queue_time_us":161}
W20260811 01:32:01.234083 1740 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:01.321161 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:01.310759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:52361)
0811 01:32:01.311373 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:01.311389 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:01.311563 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:01.311956 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:01.311960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:01.312456 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:01.312612 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.312622 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.313668 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.313675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.314723 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.314743 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.315509 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.315516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.315694 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.316390 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:01.316409 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:01.320903 (+ 4494us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":381,"threads_started":1}
W20260811 01:32:01.321400 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:01.310857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:52361 (local address 127.23.39.254:45135)
0811 01:32:01.311135 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:01.311143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:01.311487 (+ 344us) server_negotiation.cc:407] Connection header received
0811 01:32:01.311698 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:01.311710 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:01.311804 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:01.311917 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:01.312777 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.313505 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.314883 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.315309 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.315454 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.321119 (+ 5665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:52361: BlockingRecv error: recv got EOF from 127.23.39.193:52361 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:01 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:01.795451 1748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:01.785413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:35839)
0811 01:32:01.786051 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:01.786078 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:01.786231 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:01.786519 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:01.786522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:01.787036 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:01.787228 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.787238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.788388 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.788392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.789417 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:01.789429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.790250 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.790259 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:01.790399 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.791191 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:01.791209 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:01.795131 (+ 3922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":353,"threads_started":1}
W20260811 01:32:01.795751 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:01.785430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:35839 (local address 127.23.39.254:45135)
0811 01:32:01.785669 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:01.785677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:01.786153 (+ 476us) server_negotiation.cc:407] Connection header received
0811 01:32:01.786321 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:01.786325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:01.786392 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:01.786475 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:01.787415 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.788226 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.789564 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:01.789965 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:01.790067 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:01.795435 (+ 5368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:35839: BlockingRecv error: recv got EOF from 127.23.39.194:35839 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:02.245322 1750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:02.234947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:52645)
0811 01:32:02.235591 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:02.235608 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:02.235787 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:02.236208 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:02.236213 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:02.236692 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:02.236847 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.236857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.237935 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.237939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.238942 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.238954 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.239793 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.239799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.239980 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.240699 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:02.240719 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:02.245069 (+ 4350us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":378,"threads_started":1}
W20260811 01:32:02.245671 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:02.235062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:52645 (local address 127.23.39.254:45135)
0811 01:32:02.235323 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:02.235330 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:02.235710 (+ 380us) server_negotiation.cc:407] Connection header received
0811 01:32:02.235932 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:02.235937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:02.236018 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:02.236130 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:02.237019 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.237766 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.239106 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.239595 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.239739 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.245408 (+ 5669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:52645: BlockingRecv error: recv got EOF from 127.23.39.195:52645 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:02.332464 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:02.322356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:56125)
0811 01:32:02.322930 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:02.322948 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:02.323085 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:02.323461 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:02.323465 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:02.323909 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:02.324085 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.324094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.325189 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.325193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.326184 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.326197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.326991 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.326996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.327140 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.327818 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:02.327836 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:02.332087 (+ 4251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":331,"threads_started":1}
W20260811 01:32:02.332685 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:02.322380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:56125 (local address 127.23.39.254:45135)
0811 01:32:02.322581 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:02.322586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:02.323075 (+ 489us) server_negotiation.cc:407] Connection header received
0811 01:32:02.323230 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:02.323234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:02.323321 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:02.323412 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:02.324256 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.325040 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.326355 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.326806 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.326912 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.332385 (+ 5473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:56125: BlockingRecv error: recv got EOF from 127.23.39.193:56125 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:02 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:02.807514 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:02.796840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:60417)
0811 01:32:02.797494 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:02.797513 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:02.797646 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:02.798028 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:02.798032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:02.798568 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:02.798772 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.798782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.800006 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.800012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.801136 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:02.801154 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.802265 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.802273 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:02.802474 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.803224 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:02.803242 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:02.807249 (+ 4007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":418,"threads_started":1}
W20260811 01:32:02.807736 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:02.797032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:60417 (local address 127.23.39.254:45135)
0811 01:32:02.797250 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:02.797255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:02.797609 (+ 354us) server_negotiation.cc:407] Connection header received
0811 01:32:02.797764 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:02.797768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:02.797837 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:02.797934 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:02.798961 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.799781 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.801319 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:02.801945 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:02.802113 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:02.807502 (+ 5389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:60417: BlockingRecv error: recv got EOF from 127.23.39.194:60417 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:03.256145 1754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:03.246393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:36919)
0811 01:32:03.246914 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:03.246930 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:03.247049 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:03.247369 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:03.247372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:03.247824 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:03.248011 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.248020 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.249091 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.249095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.250044 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.250056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.250747 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.250752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.250880 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.251470 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:03.251487 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:03.255801 (+ 4314us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":314,"threads_started":1}
W20260811 01:32:03.256342 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:03.246504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:36919 (local address 127.23.39.254:45135)
0811 01:32:03.246758 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:03.246765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:03.247014 (+ 249us) server_negotiation.cc:407] Connection header received
0811 01:32:03.247160 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:03.247163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:03.247238 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:03.247319 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:03.248144 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.248959 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.250178 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.250579 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.250676 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.256051 (+ 5375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:36919: BlockingRecv error: recv got EOF from 127.23.39.195:36919 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:03.343884 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:03.333807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:54139)
0811 01:32:03.334409 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:03.334426 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:03.334546 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:03.334939 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:03.334943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:03.335346 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:03.335530 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.335538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.336676 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.336680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.337941 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.337957 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.338784 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.338790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.338970 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.339608 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:03.339627 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:03.343433 (+ 3806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":273,"threads_started":1}
W20260811 01:32:03.343977 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:03.333881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54139 (local address 127.23.39.254:45135)
0811 01:32:03.334060 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:03.334064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:03.334505 (+ 441us) server_negotiation.cc:407] Connection header received
0811 01:32:03.334699 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:03.334704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:03.334788 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:03.334880 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:03.335683 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.336529 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.338093 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.338616 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.338762 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.343708 (+ 4946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:54139: BlockingRecv error: recv got EOF from 127.23.39.193:54139 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:03 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:03.819003 1756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:03.808668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:37539)
0811 01:32:03.809352 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:03.809369 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:03.809566 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:03.809955 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:03.809960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:03.810466 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:03.810673 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.810684 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.811751 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.811759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.812752 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:03.812765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.813564 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.813569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:03.813755 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.814591 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:03.814610 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:03.818756 (+ 4146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":364,"threads_started":1}
W20260811 01:32:03.819352 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:03.808819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:37539 (local address 127.23.39.254:45135)
0811 01:32:03.809105 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:03.809114 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:03.809479 (+ 365us) server_negotiation.cc:407] Connection header received
0811 01:32:03.809721 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:03.809726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:03.809798 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:03.809915 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:03.810847 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.811594 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.812942 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:03.813400 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:03.813542 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:03.819043 (+ 5501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:37539: BlockingRecv error: recv got EOF from 127.23.39.194:37539 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:04.268319 1757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:04.257455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:38175)
0811 01:32:04.258351 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:04.258379 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:04.258514 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:04.258925 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:04.258949 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:04.259396 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:04.259676 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.259690 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.260969 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.260973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.261986 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.262000 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.262940 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.262945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.263164 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.263850 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:04.263869 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:04.267983 (+ 4114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":533,"threads_started":1}
W20260811 01:32:04.268653 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:04.257699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:38175 (local address 127.23.39.254:45135)
0811 01:32:04.257904 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:04.257909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:04.258474 (+ 565us) server_negotiation.cc:407] Connection header received
0811 01:32:04.258633 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:04.258639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:04.258749 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:04.258841 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:04.259845 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.260792 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.262337 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.262789 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.262890 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.268315 (+ 5425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:38175: BlockingRecv error: recv got EOF from 127.23.39.195:38175 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:04.355158 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:04.345163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:56023)
0811 01:32:04.345725 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:04.345741 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:04.345930 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:04.346339 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:04.346344 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:04.346779 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:04.346950 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.346959 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.348127 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.348132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.349458 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.349486 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.350346 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.350350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.350480 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.351098 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:04.351116 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:04.354890 (+ 3774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":339,"threads_started":1}
W20260811 01:32:04.355724 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:04.345222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:56023 (local address 127.23.39.254:45135)
0811 01:32:04.345475 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:04.345485 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:04.345864 (+ 379us) server_negotiation.cc:407] Connection header received
0811 01:32:04.346101 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:04.346105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:04.346188 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:04.346300 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:04.347116 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.347924 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.349613 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.350182 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.350281 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.355247 (+ 4966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:56023: BlockingRecv error: recv got EOF from 127.23.39.193:56023 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:04 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:04.830597 1761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:04.820155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:48953)
0811 01:32:04.820809 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:04.820827 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:04.820960 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:04.821418 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:04.821422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:04.821833 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:04.822025 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.822034 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.823263 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.823268 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.824342 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:04.824355 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.825350 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.825356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:04.825539 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.826341 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:04.826361 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:04.830319 (+ 3958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":354,"threads_started":1}
W20260811 01:32:04.830796 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:04.820271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:48953 (local address 127.23.39.254:45135)
0811 01:32:04.820489 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:04.820493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:04.820913 (+ 420us) server_negotiation.cc:407] Connection header received
0811 01:32:04.821148 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:04.821153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:04.821232 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:04.821333 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:04.822260 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.823097 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.824536 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:04.825154 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:04.825300 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:04.830563 (+ 5263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:48953: BlockingRecv error: recv got EOF from 127.23.39.194:48953 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:05.279783 1762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:05.269599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:58987)
0811 01:32:05.270229 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:05.270247 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:05.270377 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:05.270721 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:05.270724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:05.271146 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:05.271317 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.271327 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.272484 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.272489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.273643 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.273658 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.274514 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.274519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.274657 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.275380 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:05.275410 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:05.279503 (+ 4093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":335,"threads_started":1}
W20260811 01:32:05.280115 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:05.269705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:58987 (local address 127.23.39.254:45135)
0811 01:32:05.269883 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:05.269887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:05.270351 (+ 464us) server_negotiation.cc:407] Connection header received
0811 01:32:05.270478 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:05.270481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:05.270576 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:05.270671 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:05.271492 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.272297 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.273825 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.274313 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.274492 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.279761 (+ 5269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:58987: BlockingRecv error: recv got EOF from 127.23.39.195:58987 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:05.366711 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:05.356333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:46669)
0811 01:32:05.356879 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:05.356896 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:05.357021 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:05.357364 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:05.357367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:05.357838 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:05.358006 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.358015 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.359141 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.359145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.360123 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.360135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.360870 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.360875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.361009 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.361689 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:05.361708 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:05.366361 (+ 4653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":294,"threads_started":1}
W20260811 01:32:05.366990 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:05.356496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:46669 (local address 127.23.39.254:45135)
0811 01:32:05.356753 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:05.356758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:05.356983 (+ 225us) server_negotiation.cc:407] Connection header received
0811 01:32:05.357135 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:05.357138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:05.357206 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:05.357299 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:05.358232 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.358978 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.360308 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.360724 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.360830 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.366719 (+ 5889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:46669: BlockingRecv error: recv got EOF from 127.23.39.193:46669 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:05 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:05.842098 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:05.831706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:56357)
0811 01:32:05.832333 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:05.832351 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:05.832476 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:05.832815 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:05.832819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:05.833222 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:05.833387 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.833397 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.834538 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.834542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.835571 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:05.835585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.836391 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.836396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:05.836527 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.837227 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:05.837247 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:05.841730 (+ 4483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":347,"threads_started":1}
W20260811 01:32:05.842307 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:05.831976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56357 (local address 127.23.39.254:45135)
0811 01:32:05.832174 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:05.832178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:05.832433 (+ 255us) server_negotiation.cc:407] Connection header received
0811 01:32:05.832582 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:05.832586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:05.832654 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:05.832749 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:05.833545 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.834397 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.835737 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:05.836233 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:05.836349 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:05.841985 (+ 5636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:56357: BlockingRecv error: recv got EOF from 127.23.39.194:56357 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:06.301141 1766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:06.280945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:57183)
0811 01:32:06.281553 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:06.281570 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:06.281712 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:06.282096 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:06.282099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:06.282621 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:06.282808 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.282818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.283959 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.283963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.285055 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.285073 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.286251 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.286257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.286500 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.296277 (+ 9777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:06.296303 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:06.300873 (+ 4570us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":341,"threads_started":1}
W20260811 01:32:06.301342 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:06.281138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:57183 (local address 127.23.39.254:45135)
0811 01:32:06.281343 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:06.281348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:06.281703 (+ 355us) server_negotiation.cc:407] Connection header received
0811 01:32:06.281849 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:06.281853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:06.281941 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:06.282043 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:06.282998 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.283818 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.285296 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.286023 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.286205 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.301104 (+ 14899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:57183: BlockingRecv error: recv got EOF from 127.23.39.195:57183 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:06.378288 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:06.367773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:35143)
0811 01:32:06.368387 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:06.368404 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:06.368527 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:06.368906 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:06.368910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:06.369390 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:06.369622 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.369633 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.370763 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.370767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.371743 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.371756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.372562 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.372567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.372705 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.373328 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:06.373346 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:06.377829 (+ 4483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":322,"threads_started":1}
W20260811 01:32:06.378399 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:06.367853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:35143 (local address 127.23.39.254:45135)
0811 01:32:06.368058 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:06.368063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:06.368482 (+ 419us) server_negotiation.cc:407] Connection header received
0811 01:32:06.368620 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:06.368624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:06.368692 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:06.368784 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:06.369793 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.370608 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.371912 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.372410 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.372510 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.378065 (+ 5555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:35143: BlockingRecv error: recv got EOF from 127.23.39.193:35143 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:06 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:06.854210 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:06.843394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:34233)
0811 01:32:06.844003 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:06.844020 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:06.844199 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:06.844580 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:06.844585 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:06.845058 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:06.845298 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.845312 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.846769 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.846775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.848160 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:06.848174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.848939 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.848944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:06.849080 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.849740 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:06.849761 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:06.853770 (+ 4009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":354,"threads_started":1}
W20260811 01:32:06.854314 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:06.843555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:34233 (local address 127.23.39.254:45135)
0811 01:32:06.843832 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:06.843838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:06.844122 (+ 284us) server_negotiation.cc:407] Connection header received
0811 01:32:06.844358 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:06.844363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:06.844431 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:06.844539 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:06.845487 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.846606 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.848311 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:06.848763 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:06.848865 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:06.854032 (+ 5167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:34233: BlockingRecv error: recv got EOF from 127.23.39.194:34233 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:07.311957 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:07.302559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:36217)
0811 01:32:07.303146 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:07.303163 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:07.303287 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:07.303616 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:07.303620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:07.304153 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:07.304332 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.304342 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.305355 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.305359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.306350 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.306362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.307060 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.307064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.307196 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.307912 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:07.307930 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:07.311692 (+ 3762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":306,"threads_started":1}
W20260811 01:32:07.312391 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:07.302670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:36217 (local address 127.23.39.254:45135)
0811 01:32:07.302860 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:07.302866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:07.303248 (+ 382us) server_negotiation.cc:407] Connection header received
0811 01:32:07.303391 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:07.303394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:07.303482 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:07.303567 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:07.304468 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.305233 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.306481 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.306909 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.307006 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.311978 (+ 4972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:36217: BlockingRecv error: recv got EOF from 127.23.39.195:36217 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:07.389072 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:07.379341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:32967)
0811 01:32:07.380001 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:07.380018 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:07.380144 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:07.380478 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:07.380481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:07.380948 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:07.381186 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.381198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.382277 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.382281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.383307 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.383321 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.384043 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.384047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.384164 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.384848 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:07.384866 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:07.388656 (+ 3790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":322,"threads_started":1}
W20260811 01:32:07.389112 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:07.379468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:32967 (local address 127.23.39.254:45135)
0811 01:32:07.379644 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:07.379648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:07.380104 (+ 456us) server_negotiation.cc:407] Connection header received
0811 01:32:07.380271 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:07.380275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:07.380338 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:07.380423 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:07.381334 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.382082 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.383444 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.383886 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.383980 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.388942 (+ 4962us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:32967: BlockingRecv error: recv got EOF from 127.23.39.193:32967 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:07 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:07.865938 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:07.855419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:49583)
0811 01:32:07.856197 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:07.856215 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:07.856382 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:07.856729 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:07.856734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:07.857339 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:07.857540 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.857550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.858630 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.858633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.859648 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:07.859662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.860386 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.860390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:07.860510 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.861143 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:07.861161 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:07.865531 (+ 4370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":343,"threads_started":1}
W20260811 01:32:07.866093 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:07.855505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:49583 (local address 127.23.39.254:45135)
0811 01:32:07.855746 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:07.855756 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:07.856342 (+ 586us) server_negotiation.cc:407] Connection header received
0811 01:32:07.856493 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:07.856497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:07.856565 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:07.856657 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:07.857699 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.858490 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.859789 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:07.860241 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:07.860338 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:07.865808 (+ 5470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:49583: BlockingRecv error: recv got EOF from 127.23.39.194:49583 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:08.323782 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:08.313200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:38497)
0811 01:32:08.313974 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:08.313991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:08.314158 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:08.314573 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:08.314576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:08.315005 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:08.315192 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.315201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.316365 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.316369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.317375 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.317388 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.318340 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.318345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.318471 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.319080 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:08.319098 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:08.323361 (+ 4263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":354,"threads_started":1}
W20260811 01:32:08.323805 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:08.313412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:38497 (local address 127.23.39.254:45135)
0811 01:32:08.313630 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:08.313635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:08.314114 (+ 479us) server_negotiation.cc:407] Connection header received
0811 01:32:08.314329 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:08.314339 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:08.314409 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:08.314505 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:08.315398 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.316175 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.317546 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.318117 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.318287 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.323563 (+ 5276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:38497: BlockingRecv error: recv got EOF from 127.23.39.195:38497 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:08.401396 1774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:08.390388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:48099)
0811 01:32:08.390938 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:08.390956 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:08.391079 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:08.391386 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:08.391389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:08.391838 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:08.392013 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.392022 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.393120 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.393124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.394201 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.394229 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.395094 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.395101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.395248 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.396071 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:08.396098 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:08.400952 (+ 4854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":283,"threads_started":1}
W20260811 01:32:08.401598 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:08.390560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:48099 (local address 127.23.39.254:45135)
0811 01:32:08.390813 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:08.390820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:08.391044 (+ 224us) server_negotiation.cc:407] Connection header received
0811 01:32:08.391183 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:08.391187 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:08.391252 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:08.391339 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:08.392152 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.392981 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.394383 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.394867 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.394977 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.401277 (+ 6300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:48099: BlockingRecv error: recv got EOF from 127.23.39.193:48099 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:08 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:08.878957 1775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:08.867164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:52267)
0811 01:32:08.867754 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:08.867772 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:08.867902 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:08.868292 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:08.868296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:08.868823 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:08.869029 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.869039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.870731 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.870735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.871827 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:08.871845 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.872906 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.872911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:08.873045 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.873754 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:08.873775 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:08.878580 (+ 4805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":291,"threads_started":1}
W20260811 01:32:08.879143 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:08.867296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:52267 (local address 127.23.39.254:45135)
0811 01:32:08.867476 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:08.867480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:08.867879 (+ 399us) server_negotiation.cc:407] Connection header received
0811 01:32:08.868067 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:08.868071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:08.868143 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:08.868238 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:08.869235 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.870503 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.872038 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:08.872571 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:08.872796 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:08.878875 (+ 6079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:52267: BlockingRecv error: recv got EOF from 127.23.39.194:52267 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:09.334973 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:09.325127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:56259)
0811 01:32:09.325722 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:09.325748 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:09.325888 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:09.326266 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:09.326269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:09.326722 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:09.326924 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.326933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.328042 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.328046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.329502 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.329516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.330343 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.330348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.330467 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.331072 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:09.331090 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:09.334712 (+ 3622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":345,"threads_started":1}
W20260811 01:32:09.335204 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:09.325195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:56259 (local address 127.23.39.254:45135)
0811 01:32:09.325469 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:09.325479 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:09.325870 (+ 391us) server_negotiation.cc:407] Connection header received
0811 01:32:09.326007 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:09.326011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:09.326079 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:09.326243 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:09.327076 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.327876 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.329674 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.330168 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.330269 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.334940 (+ 4671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:56259: BlockingRecv error: recv got EOF from 127.23.39.195:56259 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:09.412503 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:09.402698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:42541)
0811 01:32:09.403306 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:09.403323 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:09.403499 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:09.403877 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:09.403882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:09.404363 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:09.404509 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.404517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.405627 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.405631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.406688 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.406701 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.407420 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.407426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.407614 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.408299 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:09.408317 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:09.412103 (+ 3786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":328,"threads_started":1}
W20260811 01:32:09.412616 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:09.402841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:42541 (local address 127.23.39.254:45135)
0811 01:32:09.403122 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:09.403128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:09.403430 (+ 302us) server_negotiation.cc:407] Connection header received
0811 01:32:09.403642 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:09.403648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:09.403729 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:09.403842 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:09.404666 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.405455 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.406841 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.407258 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.407395 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.412368 (+ 4973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:42541: BlockingRecv error: recv got EOF from 127.23.39.193:42541 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:09 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:09.890585 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:09.880258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:59583)
0811 01:32:09.880832 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:09.880851 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:09.881038 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:09.881456 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:09.881461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:09.881945 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:09.882116 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.882184 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.883313 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.883319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.884320 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:09.884333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.885166 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.885173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:09.885372 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.886104 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:09.886179 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:09.890333 (+ 4154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":307,"threads_started":1}
W20260811 01:32:09.890955 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:09.880422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:59583 (local address 127.23.39.254:45135)
0811 01:32:09.880703 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:09.880710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:09.880966 (+ 256us) server_negotiation.cc:407] Connection header received
0811 01:32:09.881191 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:09.881196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:09.881276 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:09.881397 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:09.882340 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.883155 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.884488 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:09.884975 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:09.885127 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:09.890620 (+ 5493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:59583: BlockingRecv error: recv got EOF from 127.23.39.194:59583 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:10.347270 1780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:10.336334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:55903)
0811 01:32:10.336976 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:10.336994 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:10.337183 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:10.337565 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:10.337571 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:10.338063 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:10.338305 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.338316 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.339417 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.339424 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.340460 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.340476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.341350 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.341356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.341556 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.342324 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:10.342343 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:10.347009 (+ 4666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":375,"threads_started":1}
W20260811 01:32:10.347549 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:10.336451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:55903 (local address 127.23.39.254:45135)
0811 01:32:10.336805 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:10.336813 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:10.337102 (+ 289us) server_negotiation.cc:407] Connection header received
0811 01:32:10.337329 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:10.337333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:10.337398 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:10.337511 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:10.338484 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.339254 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.340640 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.341157 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.341317 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.347265 (+ 5948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:55903: BlockingRecv error: recv got EOF from 127.23.39.195:55903 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:10.424342 1781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:10.413913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:57155)
0811 01:32:10.414535 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:10.414555 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:10.414693 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:10.415081 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:10.415085 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:10.415514 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:10.415684 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.415693 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.416728 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.416732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.417812 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.417826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.418719 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.418724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.418860 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.419617 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:10.419637 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:10.424066 (+ 4429us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":356,"threads_started":1}
W20260811 01:32:10.424726 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:10.414033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:57155 (local address 127.23.39.254:45135)
0811 01:32:10.414323 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:10.414327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:10.414650 (+ 323us) server_negotiation.cc:407] Connection header received
0811 01:32:10.414809 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:10.414813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:10.414880 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:10.414976 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:10.415845 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.416594 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.417971 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.418510 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.418630 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.424372 (+ 5742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:57155: BlockingRecv error: recv got EOF from 127.23.39.193:57155 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:10 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:10.901831 1782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:10.891912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:57887)
0811 01:32:10.892492 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:10.892510 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:10.892642 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:10.893001 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:10.893005 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:10.893457 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:10.893626 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.893636 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.894790 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.894796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.896078 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:10.896093 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.896828 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.896834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:10.897016 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.897667 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:10.897684 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:10.901463 (+ 3779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":329,"threads_started":1}
W20260811 01:32:10.902024 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:10.891998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:57887 (local address 127.23.39.254:45135)
0811 01:32:10.892209 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:10.892213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:10.892599 (+ 386us) server_negotiation.cc:407] Connection header received
0811 01:32:10.892756 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:10.892761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:10.892828 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:10.892924 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:10.893807 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.894615 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.896235 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:10.896654 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:10.896809 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:10.901709 (+ 4900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:57887: BlockingRecv error: recv got EOF from 127.23.39.194:57887 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:11.363633 1783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:11.348386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:44657)
0811 01:32:11.348988 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:11.349006 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:11.349163 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:11.349552 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:11.349556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:11.349994 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:11.350216 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.350226 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.351551 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.351556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.352592 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.352606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.353384 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.353388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.353510 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.359124 (+ 5614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:11.359155 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:11.363250 (+ 4095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":359,"threads_started":1}
W20260811 01:32:11.363830 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:11.348637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:44657 (local address 127.23.39.254:45135)
0811 01:32:11.348886 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:11.348893 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:11.349137 (+ 244us) server_negotiation.cc:407] Connection header received
0811 01:32:11.349290 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:11.349294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:11.349362 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:11.349453 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:11.350376 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.351346 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.352751 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.353198 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.353338 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.363525 (+ 10187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:44657: BlockingRecv error: recv got EOF from 127.23.39.195:44657 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:11.435874 1785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:11.425667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:34007)
0811 01:32:11.426326 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:11.426344 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:11.426470 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:11.426790 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:11.426793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:11.427284 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:11.427477 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.427487 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.428570 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.428579 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.429551 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.429565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.430459 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.430464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.430611 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.431276 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:11.431294 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:11.435550 (+ 4256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":309,"threads_started":1}
W20260811 01:32:11.436219 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:11.425856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:34007 (local address 127.23.39.254:45135)
0811 01:32:11.426091 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:11.426097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:11.426433 (+ 336us) server_negotiation.cc:407] Connection header received
0811 01:32:11.426579 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:11.426583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:11.426649 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:11.426742 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:11.427647 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.428435 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.429732 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.430298 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.430403 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.435950 (+ 5547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:34007: BlockingRecv error: recv got EOF from 127.23.39.193:34007 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:11 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:11.913935 1786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:11.902954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:58069)
0811 01:32:11.903618 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:11.903635 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:11.903813 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:11.904435 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:11.904443 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:11.904936 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:11.905133 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.905143 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.906367 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.906372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.907401 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:11.907416 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.908220 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.908227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:11.908502 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.909277 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:11.909296 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:11.913564 (+ 4268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":373,"threads_started":1}
W20260811 01:32:11.914089 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:11.903152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:58069 (local address 127.23.39.254:45135)
0811 01:32:11.903425 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:11.903432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:11.903735 (+ 303us) server_negotiation.cc:407] Connection header received
0811 01:32:11.903950 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:11.903957 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:11.904032 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:11.904119 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:11.905322 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.906204 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.907586 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:11.908031 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:11.908190 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:11.913798 (+ 5608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:58069: BlockingRecv error: recv got EOF from 127.23.39.194:58069 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:12.375504 1789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:12.364795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:47063)
0811 01:32:12.365365 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:12.365381 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:12.365556 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:12.365933 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:12.365939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:12.366508 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:12.366703 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.366723 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.367812 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.367818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.368867 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.368880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.369646 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.369652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.369860 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.370557 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:12.370575 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:12.375139 (+ 4564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":324,"threads_started":1}
W20260811 01:32:12.375818 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:12.364869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:47063 (local address 127.23.39.254:45135)
0811 01:32:12.365128 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:12.365137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:12.365482 (+ 345us) server_negotiation.cc:407] Connection header received
0811 01:32:12.365698 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:12.365703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:12.365775 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:12.365893 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:12.366877 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.367650 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.369017 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.369469 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.369650 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.375482 (+ 5832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:47063: BlockingRecv error: recv got EOF from 127.23.39.195:47063 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:12.447491 1790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:12.437115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:60339)
0811 01:32:12.437755 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:12.437773 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:12.437965 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:12.438446 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:12.438454 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:12.438963 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:12.439211 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.439232 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.440331 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.440338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.441288 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.441301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.442119 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.442149 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.442357 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.443106 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:12.443125 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:12.447163 (+ 4038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":361,"threads_started":1}
W20260811 01:32:12.447871 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:12.437249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60339 (local address 127.23.39.254:45135)
0811 01:32:12.437585 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:12.437601 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:12.437883 (+ 282us) server_negotiation.cc:407] Connection header received
0811 01:32:12.438145 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:12.438176 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:12.438283 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:12.438398 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:12.439374 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.440176 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.441455 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.441954 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.442103 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.447454 (+ 5351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:60339: BlockingRecv error: recv got EOF from 127.23.39.193:60339 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:12 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:12.925022 1791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:12.915270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:47099)
0811 01:32:12.915934 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:12.915952 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:12.916143 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:12.916532 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:12.916536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:12.916999 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:12.917180 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.917189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.918260 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.918266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.919209 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:12.919229 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.920006 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.920011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:12.920214 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.920862 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:12.920880 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:12.924628 (+ 3748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":326,"threads_started":1}
W20260811 01:32:12.925202 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:12.915537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:47099 (local address 127.23.39.254:45135)
0811 01:32:12.915704 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:12.915709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:12.916068 (+ 359us) server_negotiation.cc:407] Connection header received
0811 01:32:12.916300 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:12.916308 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:12.916381 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:12.916499 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:12.917347 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.918087 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.919382 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:12.919841 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:12.919989 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:12.924910 (+ 4921us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:47099: BlockingRecv error: recv got EOF from 127.23.39.194:47099 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:13.386744 1792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:13.376895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:39865)
0811 01:32:13.377611 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:13.377627 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:13.377828 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:13.378217 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:13.378230 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:13.378669 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:13.378843 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.378852 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.379960 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.379965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.380913 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.380925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.381687 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.381694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.381896 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.382633 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:13.382653 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:13.386448 (+ 3795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":454,"threads_started":1}
W20260811 01:32:13.387075 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:13.376999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:39865 (local address 127.23.39.254:45135)
0811 01:32:13.377364 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:13.377373 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:13.377746 (+ 373us) server_negotiation.cc:407] Connection header received
0811 01:32:13.377989 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:13.377994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:13.378058 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:13.378192 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:13.379003 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.379814 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.381065 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.381491 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.381637 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.386780 (+ 5143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:39865: BlockingRecv error: recv got EOF from 127.23.39.195:39865 (error 108)
Metrics: {"server-negotiator.queue_time_us":195}
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:13.459052 1795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:13.448516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:34205)
0811 01:32:13.449082 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:13.449102 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:13.449234 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:13.449580 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:13.449583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:13.450022 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:13.450254 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.450265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.451454 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.451459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.452521 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.452534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.453277 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.453283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.453441 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.454111 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:13.454199 (+ 88us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:13.458637 (+ 4438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":336,"threads_started":1}
W20260811 01:32:13.459246 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:13.448692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:34205 (local address 127.23.39.254:45135)
0811 01:32:13.448912 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:13.448917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:13.449200 (+ 283us) server_negotiation.cc:407] Connection header received
0811 01:32:13.449341 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:13.449345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:13.449415 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:13.449509 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:13.450431 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.451291 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.452701 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.453111 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.453217 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.458896 (+ 5679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:34205: BlockingRecv error: recv got EOF from 127.23.39.193:34205 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:13 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:13.936662 1796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:13.926516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:56105)
0811 01:32:13.927173 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:13.927193 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:13.927333 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:13.927678 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:13.927681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:13.928204 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:13.928378 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.928387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.929550 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.929555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.930602 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:13.930616 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.931404 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.931408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:13.931538 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.932519 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:13.932541 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:13.936411 (+ 3870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":350,"threads_started":1}
W20260811 01:32:13.936978 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:13.926724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56105 (local address 127.23.39.254:45135)
0811 01:32:13.926950 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:13.926955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:13.927302 (+ 347us) server_negotiation.cc:407] Connection header received
0811 01:32:13.927444 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:13.927448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:13.927514 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:13.927609 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:13.928582 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.929374 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.930780 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:13.931259 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:13.931370 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:13.936672 (+ 5302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:56105: BlockingRecv error: recv got EOF from 127.23.39.194:56105 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.195@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:14.398821 1797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:14.387896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.195:43815)
0811 01:32:14.388470 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:14.388487 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:14.388622 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:14.388972 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:14.388975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:14.389446 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:14.389623 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.389634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.391019 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.391025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.392474 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.392489 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.393277 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.393282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.393434 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.394276 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:14.394299 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:14.398531 (+ 4232us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":340,"threads_started":1}
W20260811 01:32:14.399163 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:14.388041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:43815 (local address 127.23.39.254:45135)
0811 01:32:14.388232 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:14.388239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:14.388571 (+ 332us) server_negotiation.cc:407] Connection header received
0811 01:32:14.388751 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:14.388755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:14.388820 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:14.388920 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:14.389845 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.390860 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.392615 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.393027 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.393125 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.398853 (+ 5728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.195:43815: BlockingRecv error: recv got EOF from 127.23.39.195:43815 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.193@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:14.471143 1798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:14.460688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.193:57551)
0811 01:32:14.461240 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:14.461263 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:14.461429 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:14.461773 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:14.461777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:14.462305 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:14.462523 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.462537 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.463740 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.463744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.464713 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.464725 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.465598 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.465602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.465750 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.466503 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:14.466527 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:14.470753 (+ 4226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":489,"threads_started":1}
W20260811 01:32:14.471251 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:14.460796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:57551 (local address 127.23.39.254:45135)
0811 01:32:14.461172 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:14.461179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:14.461378 (+ 199us) server_negotiation.cc:407] Connection header received
0811 01:32:14.461542 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:14.461546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:14.461610 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:14.461721 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:14.462782 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.463582 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.464874 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.465428 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.465543 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.470971 (+ 5428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.193:57551: BlockingRecv error: recv got EOF from 127.23.39.193:57551 (error 108)
Metrics: {"server-negotiator.queue_time_us":218}
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 01:32:14 dist-test-slave-9jjr krb5kdc[570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.39.194@KRBTEST.COM for oryx/127.23.39.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 01:32:14.949410 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:14.938205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:45135 (local address 127.23.39.194:53533)
0811 01:32:14.938856 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:14.938881 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:14.939027 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:14.939348 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:14.939351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:14.939812 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:14.940081 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.940096 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.941537 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.941543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.942920 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:14.942936 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.943862 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.943866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:14.944010 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.944870 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:14.944891 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:14.949118 (+ 4227us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.39.254:45135: Server oryx/127.23.39.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":358,"threads_started":1}
W20260811 01:32:14.949878 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:14.938344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:53533 (local address 127.23.39.254:45135)
0811 01:32:14.938552 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:14.938556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:14.939027 (+ 471us) server_negotiation.cc:407] Connection header received
0811 01:32:14.939127 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:14.939131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:14.939202 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:14.939306 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:14.940255 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.941372 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.943106 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:14.943692 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:14.943813 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:14.949448 (+ 5635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.39.194:53533: BlockingRecv error: recv got EOF from 127.23.39.194:53533 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:32:15.043507 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1258
I20260811 01:32:15.058733 1802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:15.045058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40656 (local address 127.23.39.193:33121)
0811 01:32:15.045898 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:15.045907 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:15.045940 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:32:15.046022 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:15.046029 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:15.046393 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:15.046594 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:15.048262 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.049480 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.050900 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.051520 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.051636 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:15.054555 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:15.054565 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:15.054581 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:15.054625 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:15.058027 (+ 3402us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:32:15.058496 (+ 469us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40656: Request ticket server kudu/127.23.39.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":488,"threads_started":1}
W20260811 01:32:15.058836 1802 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40656: Request ticket server kudu/127.23.39.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:32:15.059284 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1258: Not authorized: Client connection negotiation failed: client connection to 127.23.39.193:33121: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:32:15.059518 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1258
I20260811 01:32:15.086400 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1435
I20260811 01:32:15.100564 1803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:15.087863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47494 (local address 127.23.39.194:35157)
0811 01:32:15.088612 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:15.088620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:15.088651 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:32:15.088721 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:15.088728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:15.089001 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:15.089234 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:15.090805 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.091932 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.093256 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.093889 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.094045 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:15.096934 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:15.096944 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:15.096959 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:15.097006 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:15.099809 (+ 2803us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:32:15.100215 (+ 406us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47494: Request ticket server kudu/127.23.39.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":397,"threads_started":1}
W20260811 01:32:15.100687 1803 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47494: Request ticket server kudu/127.23.39.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:32:15.100642 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1435: Not authorized: Client connection negotiation failed: client connection to 127.23.39.194:35157: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:32:15.100833 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1435
I20260811 01:32:15.123175 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1590
I20260811 01:32:15.138365 1804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:15.124576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56030 (local address 127.23.39.195:39365)
0811 01:32:15.125195 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:15.125203 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:15.125235 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:32:15.125315 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:15.125322 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:15.125581 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:15.125841 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:15.127891 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.128966 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.130351 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.131013 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.131196 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:15.134263 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:15.134282 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:15.134305 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:15.134376 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:15.137501 (+ 3125us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0811 01:32:15.137957 (+ 456us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56030: Request ticket server kudu/127.23.39.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":302,"threads_started":1}
W20260811 01:32:15.138447 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1590: Not authorized: Client connection negotiation failed: client connection to 127.23.39.195:39365: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.23.39.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260811 01:32:15.138496 1804 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56030: Request ticket server kudu/127.23.39.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260811 01:32:15.138675 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1590
I20260811 01:32:15.162354 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1176
I20260811 01:32:15.163992 1251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:15.289762 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1176
2026-08-11T01:32:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22039 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T01:32:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:32:15Z Disabled control of system clock
I20260811 01:32:15.392197 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44249
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:44249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 01:32:15.766379 1809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:15.766726 1809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:15.766814 1809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:15.774435 1809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:32:15.774561 1809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:15.774600 1809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:15.774655 1809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:32:15.774724 1809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:32:15.784621 1809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:44249
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:44249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:15.786051 1809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:15.788035 1809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:15.801393 1814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:15.801448 1817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:15.801424 1815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:15.801860 1809 server_base.cc:1034] running on GCE node
I20260811 01:32:15.802973 1809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:15.804564 1809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:15.805830 1809 hybrid_clock.cc:648] HybridClock initialized: now 1786411935805779 us; error 50 us; skew 500 ppm
I20260811 01:32:15.806293 1809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:15.808847 1809 webserver.cc:460] Webserver started at http://127.23.39.254:37505/ using document root <none> and password file <none>
I20260811 01:32:15.809681 1809 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:15.809835 1809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:15.810276 1809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:15.813669 1809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "ce5ebe6c8c0a44959e043d3cc49f266c"
format_stamp: "Formatted at 2026-08-11 01:32:15 on dist-test-slave-9jjr"
server_key: "6aebaa057809a0d9aba89268abdcd230"
server_key_iv: "8f52d8dee19bee9d4ffb4760a936ebad"
server_key_version: "encryptionkey@0"
I20260811 01:32:15.814678 1809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "ce5ebe6c8c0a44959e043d3cc49f266c"
format_stamp: "Formatted at 2026-08-11 01:32:15 on dist-test-slave-9jjr"
server_key: "6aebaa057809a0d9aba89268abdcd230"
server_key_iv: "8f52d8dee19bee9d4ffb4760a936ebad"
server_key_version: "encryptionkey@0"
I20260811 01:32:15.820699 1809 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260811 01:32:15.824988 1825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:15.826709 1809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:32:15.826965 1809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "ce5ebe6c8c0a44959e043d3cc49f266c"
format_stamp: "Formatted at 2026-08-11 01:32:15 on dist-test-slave-9jjr"
server_key: "6aebaa057809a0d9aba89268abdcd230"
server_key_iv: "8f52d8dee19bee9d4ffb4760a936ebad"
server_key_version: "encryptionkey@0"
I20260811 01:32:15.827260 1809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:15.862058 1809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:15.863204 1809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:15.863569 1809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:15.885118 1809 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:44249
I20260811 01:32:15.885156 1882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:44249 every 8 connection(s)
I20260811 01:32:15.886646 1809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:32:15.890954 1883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:32:15.894673 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1809
I20260811 01:32:15.894893 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:32:15.895784 23711 external_mini_cluster.cc:1428] Setting key 40c1802f52238af38182b84281f6f81a
I20260811 01:32:15.905367 1883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c: Bootstrap starting.
I20260811 01:32:15.909288 1883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:15.910554 1883 log.cc:824] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:15.911155 1886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:15.898220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.23.39.254:44249)
0811 01:32:15.899330 (+ 1110us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:15.899342 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:15.899384 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:32:15.901064 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:15.901089 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:15.901620 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:15.901984 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:15.902745 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.904096 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.906047 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:15.906846 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:15.906995 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:15.908414 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:15.908423 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:15.908440 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:15.909007 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:15.909123 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:15.909146 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:15.909242 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:15.909573 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 01:32:15.909946 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":380,"threads_started":1}
I20260811 01:32:15.913877 1883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c: No bootstrap required, opened a new log
I20260811 01:32:15.921811 1883 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } }
I20260811 01:32:15.922297 1883 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:15.922374 1883 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5ebe6c8c0a44959e043d3cc49f266c, State: Initialized, Role: FOLLOWER
I20260811 01:32:15.922920 1883 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } }
I20260811 01:32:15.923173 1883 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:32:15.923273 1883 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:32:15.923413 1883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:15.925745 1883 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } }
I20260811 01:32:15.926486 1883 leader_election.cc:302] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5ebe6c8c0a44959e043d3cc49f266c; no voters:
I20260811 01:32:15.927201 1883 leader_election.cc:288] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:32:15.927371 1888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:32:15.928105 1888 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [term 1 LEADER]: Becoming Leader. State: Replica: ce5ebe6c8c0a44959e043d3cc49f266c, State: Running, Role: LEADER
I20260811 01:32:15.928689 1888 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } }
I20260811 01:32:15.929502 1883 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:32:15.932111 1890 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5ebe6c8c0a44959e043d3cc49f266c. Latest consensus state: current_term: 1 leader_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } } }
I20260811 01:32:15.932497 1890 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:15.933290 1889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5ebe6c8c0a44959e043d3cc49f266c" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 44249 } } }
I20260811 01:32:15.933688 1889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:15.934653 1895 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:32:15.940349 1895 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:32:15.951604 1895 catalog_manager.cc:1347] Generated new cluster ID: 8178439df95143599ef523faa3e9ebc3
I20260811 01:32:15.951769 1895 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:32:15.963948 1895 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:32:15.965924 1895 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:32:15.978915 1895 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5ebe6c8c0a44959e043d3cc49f266c: Generated new TSK 0
I20260811 01:32:15.979880 1895 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:32:15.989996 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--builtin_ntp_servers=127.23.39.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 01:32:16.382687 1913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:16.382994 1913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:16.383105 1913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:16.390614 1913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:16.390736 1913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:16.390846 1913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:32:16.400460 1913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:16.401770 1913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:16.403635 1913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:16.419433 1922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:16.419373 1919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:16.419487 1918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:16.420923 1913 server_base.cc:1034] running on GCE node
I20260811 01:32:16.421742 1913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:16.422951 1913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:16.424245 1913 hybrid_clock.cc:648] HybridClock initialized: now 1786411936424152 us; error 86 us; skew 500 ppm
I20260811 01:32:16.424638 1913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:16.432211 1913 webserver.cc:460] Webserver started at http://127.23.39.193:45353/ using document root <none> and password file <none>
I20260811 01:32:16.433138 1913 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:16.433320 1913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:16.433718 1913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:16.437172 1913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "a529b229a5244e82b2054387e49782bd"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "55839e974e2fac6524a400d1ee805eed"
server_key_iv: "2d810188de30c0c779bc47392aff890b"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.438252 1913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "a529b229a5244e82b2054387e49782bd"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "55839e974e2fac6524a400d1ee805eed"
server_key_iv: "2d810188de30c0c779bc47392aff890b"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.444283 1913 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:32:16.448370 1930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:16.450098 1913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:32:16.450415 1913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "a529b229a5244e82b2054387e49782bd"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "55839e974e2fac6524a400d1ee805eed"
server_key_iv: "2d810188de30c0c779bc47392aff890b"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.450680 1913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:16.468317 1913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:16.469323 1913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:16.469673 1913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:16.470824 1913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:16.472453 1913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:16.472584 1913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:16.472734 1913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:16.472833 1913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:16.508627 1913 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:35375
I20260811 01:32:16.508780 2064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:35375 every 8 connection(s)
I20260811 01:32:16.510077 1913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:32:16.519466 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 1913
I20260811 01:32:16.519681 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:32:16.520391 23711 external_mini_cluster.cc:1428] Setting key 7fa9b4bd6405864f0e8e2afbc4aa74c7
I20260811 01:32:16.523350 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--builtin_ntp_servers=127.23.39.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 01:32:16.524155 2067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:16.513046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:53951 (local address 127.23.39.254:44249)
0811 01:32:16.513535 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:16.513543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:16.515067 (+ 1524us) server_negotiation.cc:407] Connection header received
0811 01:32:16.516953 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:16.516957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:16.517042 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:16.517150 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:16.518405 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:16.519135 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:16.521064 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:16.521515 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:16.521656 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:16.523170 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:16.523175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:16.523178 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:16.523201 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:16.523242 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:16.523254 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:16.523354 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:16.523674 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 01:32:16.523791 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":228,"threads_started":1}
I20260811 01:32:16.525218 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:16.513761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44249 (local address 127.23.39.193:53951)
0811 01:32:16.514875 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:16.514922 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:16.516664 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:16.517409 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:16.517418 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:16.517515 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:16.518195 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:16.518231 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:16.519345 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:16.519349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:16.520880 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:16.520894 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:16.521768 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:16.521777 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:16.522016 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:16.522801 (+ 785us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:16.522803 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:16.522846 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:16.522931 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:16.523367 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:16.523380 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:16.523392 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:32:16.523627 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 01:32:16.524071 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":417,"threads_started":1}
I20260811 01:32:16.527105 2065 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44249
I20260811 01:32:16.527500 2065 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:16.528617 2065 heartbeater.cc:511] Master 127.23.39.254:44249 requested a full tablet report, sending...
I20260811 01:32:16.531562 1846 ts_manager.cc:194] Registered new tserver with Master: a529b229a5244e82b2054387e49782bd (127.23.39.193:35375)
I20260811 01:32:16.533535 1846 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.193:53951
W20260811 01:32:16.905541 2071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:16.905980 2071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:16.906173 2071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:16.915575 2071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:16.915722 2071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:16.915834 2071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:32:16.926702 2071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:16.928102 2071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:16.930421 2071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:16.945920 2080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:16.946058 2078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:16.946159 2076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:16.947261 2071 server_base.cc:1034] running on GCE node
I20260811 01:32:16.948035 2071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:16.949098 2071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:16.950318 2071 hybrid_clock.cc:648] HybridClock initialized: now 1786411936950264 us; error 43 us; skew 500 ppm
I20260811 01:32:16.950691 2071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:16.953306 2071 webserver.cc:460] Webserver started at http://127.23.39.194:46799/ using document root <none> and password file <none>
I20260811 01:32:16.954206 2071 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:16.954325 2071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:16.954788 2071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:16.958250 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "83755b916b2a403682ae1bce7fdffd6d"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "4acbb1b1336fbca554c4ccba3066e22c"
server_key_iv: "68ab86ed80c19abb1c846ad76be0b39a"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.959337 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "83755b916b2a403682ae1bce7fdffd6d"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "4acbb1b1336fbca554c4ccba3066e22c"
server_key_iv: "68ab86ed80c19abb1c846ad76be0b39a"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.965334 2071 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260811 01:32:16.969466 2086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:16.970974 2071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:32:16.971186 2071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "83755b916b2a403682ae1bce7fdffd6d"
format_stamp: "Formatted at 2026-08-11 01:32:16 on dist-test-slave-9jjr"
server_key: "4acbb1b1336fbca554c4ccba3066e22c"
server_key_iv: "68ab86ed80c19abb1c846ad76be0b39a"
server_key_version: "encryptionkey@0"
I20260811 01:32:16.971442 2071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:16.988981 2071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:16.989966 2071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:16.990361 2071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:16.991530 2071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:16.993155 2071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:16.993275 2071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:16.993432 2071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:16.993526 2071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:17.030649 2071 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:36287
I20260811 01:32:17.030707 2213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:36287 every 8 connection(s)
I20260811 01:32:17.032325 2071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:32:17.039498 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2071
I20260811 01:32:17.039696 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:32:17.040354 23711 external_mini_cluster.cc:1428] Setting key 60e19b9b1945968f7eeee6901a4cc806
I20260811 01:32:17.043702 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--builtin_ntp_servers=127.23.39.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 01:32:17.047657 2216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.035292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56733 (local address 127.23.39.254:44249)
0811 01:32:17.035871 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.035876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.037412 (+ 1536us) server_negotiation.cc:407] Connection header received
0811 01:32:17.039674 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.039683 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.039842 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.039955 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.041510 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.042612 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.044470 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.044934 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.045081 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.046699 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:17.046705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:17.046708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:17.046737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:17.046786 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:17.046799 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:17.046907 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:17.047163 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 01:32:17.047285 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":293,"threads_started":1}
I20260811 01:32:17.048830 2217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.036133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44249 (local address 127.23.39.194:56733)
0811 01:32:17.037184 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:17.037258 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:17.039248 (+ 1990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:17.040305 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:17.040321 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:17.040470 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:17.041306 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:17.041327 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.042793 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.042798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:17.044293 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:17.044309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.045219 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.045231 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:17.045486 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.046316 (+ 830us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:17.046319 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:17.046365 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:17.046458 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:17.046907 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:17.046923 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:17.046934 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:32:17.047149 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 01:32:17.047635 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":387,"threads_started":1}
I20260811 01:32:17.050522 2214 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44249
I20260811 01:32:17.050859 2214 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:17.051707 2214 heartbeater.cc:511] Master 127.23.39.254:44249 requested a full tablet report, sending...
I20260811 01:32:17.053339 1846 ts_manager.cc:194] Registered new tserver with Master: 83755b916b2a403682ae1bce7fdffd6d (127.23.39.194:36287)
I20260811 01:32:17.054337 1846 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.194:56733
W20260811 01:32:17.421582 2218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:17.421912 2218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:17.422003 2218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:17.429996 2218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:17.430120 2218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:17.430353 2218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:32:17.441354 2218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:44249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:17.442865 2218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:17.444772 2218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:17.459553 2226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:17.459483 2227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:17.459465 2229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:17.460444 2218 server_base.cc:1034] running on GCE node
I20260811 01:32:17.461186 2218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:17.462427 2218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:17.463670 2218 hybrid_clock.cc:648] HybridClock initialized: now 1786411937463612 us; error 49 us; skew 500 ppm
I20260811 01:32:17.464044 2218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:17.466876 2218 webserver.cc:460] Webserver started at http://127.23.39.195:33223/ using document root <none> and password file <none>
I20260811 01:32:17.467762 2218 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:17.467890 2218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:17.468267 2218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:17.471499 2218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "38dbe0392636492da943d7ecfbeeaf1a"
format_stamp: "Formatted at 2026-08-11 01:32:17 on dist-test-slave-9jjr"
server_key: "3122e1597f17cba78c882319740b2621"
server_key_iv: "8916cda2d9ad8d49087888a68739a96b"
server_key_version: "encryptionkey@0"
I20260811 01:32:17.472421 2218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "38dbe0392636492da943d7ecfbeeaf1a"
format_stamp: "Formatted at 2026-08-11 01:32:17 on dist-test-slave-9jjr"
server_key: "3122e1597f17cba78c882319740b2621"
server_key_iv: "8916cda2d9ad8d49087888a68739a96b"
server_key_version: "encryptionkey@0"
I20260811 01:32:17.478681 2218 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:32:17.482785 2236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:17.484365 2218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:32:17.484584 2218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "38dbe0392636492da943d7ecfbeeaf1a"
format_stamp: "Formatted at 2026-08-11 01:32:17 on dist-test-slave-9jjr"
server_key: "3122e1597f17cba78c882319740b2621"
server_key_iv: "8916cda2d9ad8d49087888a68739a96b"
server_key_version: "encryptionkey@0"
I20260811 01:32:17.484843 2218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:17.530676 2218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:17.531679 2218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:17.532052 2218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:17.533072 2218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:17.534770 2218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:17.534869 2218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:17.534957 2218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:17.535013 2218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:17.537669 2065 heartbeater.cc:503] Master 127.23.39.254:44249 was elected leader, sending a full tablet report...
I20260811 01:32:17.571517 2218 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:42539
I20260811 01:32:17.571573 2369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:42539 every 8 connection(s)
I20260811 01:32:17.572898 2218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:32:17.579977 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2218
I20260811 01:32:17.580175 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:32:17.580638 23711 external_mini_cluster.cc:1428] Setting key 1b08cb73553de18da6a209335e210c0b
I20260811 01:32:17.587527 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.575934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:40411 (local address 127.23.39.254:44249)
0811 01:32:17.576430 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.576435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.577704 (+ 1269us) server_negotiation.cc:407] Connection header received
0811 01:32:17.579692 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.579698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.579805 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.579931 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.581223 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.582355 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.584380 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.584804 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.584950 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.586560 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:17.586565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:17.586569 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:17.586589 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:17.586632 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:17.586644 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:17.586777 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:17.587017 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:32:17.587128 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":253,"threads_started":1}
I20260811 01:32:17.588706 2373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.576602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:44249 (local address 127.23.39.195:40411)
0811 01:32:17.577536 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:17.577574 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:17.579347 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:17.580236 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:17.580246 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:17.580388 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:17.581044 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:17.581063 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.582517 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.582522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:17.584225 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:17.584240 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.585068 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.585077 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:17.585330 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.586176 (+ 846us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:17.586181 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:17.586238 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:17.586337 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:17.586777 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:17.586791 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:17.586803 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:32:17.587004 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 01:32:17.587474 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":292,"threads_started":1}
I20260811 01:32:17.590610 2370 heartbeater.cc:347] Connected to a master server at 127.23.39.254:44249
I20260811 01:32:17.590909 2370 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:17.591740 2370 heartbeater.cc:511] Master 127.23.39.254:44249 requested a full tablet report, sending...
I20260811 01:32:17.593288 1846 ts_manager.cc:194] Registered new tserver with Master: 38dbe0392636492da943d7ecfbeeaf1a (127.23.39.195:42539)
I20260811 01:32:17.594106 1846 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.195:40411
I20260811 01:32:17.596855 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:32:17.604044 2372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:17.602034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57806 (local address 127.23.39.254:44249)
0811 01:32:17.602534 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.602544 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.602895 (+ 351us) server_negotiation.cc:407] Connection header received
0811 01:32:17.603133 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.603137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.603205 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.603316 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.603833 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57806: BlockingRecv error: recv got EOF from 127.0.0.1:57806 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:32:17.604964 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1913
I20260811 01:32:17.613106 2382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.606028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54994 (local address 127.23.39.193:35375)
0811 01:32:17.606615 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.606623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.606649 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:32:17.606706 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.606712 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.606933 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.607062 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.607442 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.608558 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.609830 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.610486 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.610598 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.611676 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:17.611685 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:17.611697 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:17.612290 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:17.612339 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:17.612361 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:17.612463 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:17.612560 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 01:32:17.612675 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":311,"threads_started":1}
I20260811 01:32:17.614658 2059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:17.704130 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1913
I20260811 01:32:17.724341 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2071
I20260811 01:32:17.733448 2384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.725443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41834 (local address 127.23.39.194:36287)
0811 01:32:17.725994 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.726000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.726028 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:32:17.726097 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.726104 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.726511 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.726704 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.727168 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.728207 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.729563 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.730268 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.730415 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.731656 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:17.731668 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:17.731684 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:17.732455 (+ 771us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:17.732519 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:17.732542 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:17.732686 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:17.732878 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 01:32:17.733050 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":279,"threads_started":1}
I20260811 01:32:17.734920 2209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:17.820717 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2071
I20260811 01:32:17.843343 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2218
I20260811 01:32:17.852763 2386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:17.844443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56700 (local address 127.23.39.195:42539)
0811 01:32:17.845106 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:17.845114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:17.845149 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:32:17.845215 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:17.845222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:17.845462 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:17.845782 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:17.846384 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.847505 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.848940 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:17.849593 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:17.849760 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:17.851117 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:17.851128 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:17.851143 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:17.851810 (+ 667us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:17.851864 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:17.851888 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:17.852032 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:17.852187 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 01:32:17.852344 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":317,"threads_started":1}
I20260811 01:32:17.854527 2365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:17.948524 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2218
I20260811 01:32:17.969451 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 1809
I20260811 01:32:17.970875 1878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:18.080797 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 1809
2026-08-11T01:32:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2786 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T01:32:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:32:18Z Disabled control of system clock
I20260811 01:32:18.178546 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43479
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:45161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:43479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:32:18.548308 2394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:18.548663 2394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:18.548763 2394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:18.556670 2394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:32:18.556818 2394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:18.556859 2394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:18.556910 2394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:32:18.556953 2394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:32:18.566781 2394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:43479
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:18.568149 2394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:18.569991 2394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:18.582391 2399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:18.582414 2400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:18.582307 2402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:18.583712 2394 server_base.cc:1034] running on GCE node
I20260811 01:32:18.584623 2394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:18.586247 2394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:18.587544 2394 hybrid_clock.cc:648] HybridClock initialized: now 1786411938587464 us; error 70 us; skew 500 ppm
I20260811 01:32:18.587984 2394 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:18.590823 2394 webserver.cc:460] Webserver started at http://127.23.39.254:35749/ using document root <none> and password file <none>
I20260811 01:32:18.591655 2394 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:18.591826 2394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:18.592206 2394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:18.595593 2394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "78403f7bb0dc49499759ca8e6fbc60a7"
format_stamp: "Formatted at 2026-08-11 01:32:18 on dist-test-slave-9jjr"
server_key: "eb4ce3a90ed761657f0a0a470f1e521c"
server_key_iv: "75c7247a65ebc13b150dbdaec8707ea6"
server_key_version: "encryptionkey@0"
I20260811 01:32:18.596509 2394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "78403f7bb0dc49499759ca8e6fbc60a7"
format_stamp: "Formatted at 2026-08-11 01:32:18 on dist-test-slave-9jjr"
server_key: "eb4ce3a90ed761657f0a0a470f1e521c"
server_key_iv: "75c7247a65ebc13b150dbdaec8707ea6"
server_key_version: "encryptionkey@0"
I20260811 01:32:18.602627 2394 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:32:18.606781 2409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:18.608343 2394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:32:18.608574 2394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "78403f7bb0dc49499759ca8e6fbc60a7"
format_stamp: "Formatted at 2026-08-11 01:32:18 on dist-test-slave-9jjr"
server_key: "eb4ce3a90ed761657f0a0a470f1e521c"
server_key_iv: "75c7247a65ebc13b150dbdaec8707ea6"
server_key_version: "encryptionkey@0"
I20260811 01:32:18.608840 2394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:18.615486 2394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:18.616570 2394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:18.616930 2394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:18.637809 2394 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:43479
I20260811 01:32:18.637850 2472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:43479 every 8 connection(s)
I20260811 01:32:18.639346 2394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:32:18.642064 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2394
I20260811 01:32:18.642361 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:32:18.643282 23711 external_mini_cluster.cc:1428] Setting key c166c98324fd4b4f5520206d25347836
I20260811 01:32:18.644942 2473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:32:18.654893 2476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:18.645861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50956 (local address 127.23.39.254:43479)
0811 01:32:18.647226 (+ 1365us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:18.647239 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:18.647305 (+ 66us) server_negotiation.cc:407] Connection header received
0811 01:32:18.650194 (+ 2889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:18.650283 (+ 89us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:18.650927 (+ 644us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:18.651418 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:18.652841 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:18.652849 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:18.652865 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:18.652885 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:18.652980 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:18.652999 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:18.653239 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:18.653358 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 01:32:18.653722 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":573,"threads_started":1}
I20260811 01:32:18.662108 2473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7: Bootstrap starting.
I20260811 01:32:18.666003 2473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:18.667176 2473 log.cc:824] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:18.670890 2473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7: No bootstrap required, opened a new log
I20260811 01:32:18.679226 2473 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } }
I20260811 01:32:18.679648 2473 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:18.679714 2473 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78403f7bb0dc49499759ca8e6fbc60a7, State: Initialized, Role: FOLLOWER
I20260811 01:32:18.680450 2473 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } }
I20260811 01:32:18.680748 2473 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:32:18.680900 2473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:32:18.681092 2473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:18.683531 2473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } }
I20260811 01:32:18.684101 2473 leader_election.cc:302] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78403f7bb0dc49499759ca8e6fbc60a7; no voters:
I20260811 01:32:18.684777 2473 leader_election.cc:288] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:32:18.684976 2478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:32:18.685936 2478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [term 1 LEADER]: Becoming Leader. State: Replica: 78403f7bb0dc49499759ca8e6fbc60a7, State: Running, Role: LEADER
I20260811 01:32:18.686573 2478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } }
I20260811 01:32:18.687148 2473 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:32:18.689859 2479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } } }
I20260811 01:32:18.690416 2479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:18.689900 2480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78403f7bb0dc49499759ca8e6fbc60a7. Latest consensus state: current_term: 1 leader_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78403f7bb0dc49499759ca8e6fbc60a7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43479 } } }
I20260811 01:32:18.692274 2480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:18.693797 2485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:32:18.699807 2485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:32:18.710554 2485 catalog_manager.cc:1347] Generated new cluster ID: 3cc1f5c7bb30468bbeaa4bca8542f594
I20260811 01:32:18.710703 2485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:32:18.739712 2485 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:32:18.740350 2485 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:32:18.755043 2485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78403f7bb0dc49499759ca8e6fbc60a7: Generated new TSK 0
I20260811 01:32:18.756356 2485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:32:18.767629 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--builtin_ntp_servers=127.23.39.212:45161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 01:32:19.160102 2499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:19.160507 2499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:19.160662 2499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:19.168421 2499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:19.168561 2499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:19.168751 2499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:32:19.178431 2499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:19.179876 2499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:19.181924 2499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:19.197139 2505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:19.197268 2506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:19.197171 2508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:19.198434 2499 server_base.cc:1034] running on GCE node
I20260811 01:32:19.199239 2499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:19.200357 2499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:19.201609 2499 hybrid_clock.cc:648] HybridClock initialized: now 1786411939201537 us; error 72 us; skew 500 ppm
I20260811 01:32:19.202011 2499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:19.204674 2499 webserver.cc:460] Webserver started at http://127.23.39.193:34119/ using document root <none> and password file <none>
I20260811 01:32:19.205458 2499 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:19.205560 2499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:19.205889 2499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:19.209110 2499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "b8faa00b185546d39cb5e735b98a4f9c"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "1c0b56369ef1f2b9bba0147749a53c15"
server_key_iv: "33c41e30820cea935ded7d37909903c6"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.209957 2499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "b8faa00b185546d39cb5e735b98a4f9c"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "1c0b56369ef1f2b9bba0147749a53c15"
server_key_iv: "33c41e30820cea935ded7d37909903c6"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.215981 2499 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 01:32:19.219874 2515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.221467 2499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:32:19.221648 2499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "b8faa00b185546d39cb5e735b98a4f9c"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "1c0b56369ef1f2b9bba0147749a53c15"
server_key_iv: "33c41e30820cea935ded7d37909903c6"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.221909 2499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:19.228338 2499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:19.229249 2499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:19.229554 2499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:19.230743 2499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:19.232448 2499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:19.232573 2499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.232717 2499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:19.232803 2499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.269409 2499 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33887
I20260811 01:32:19.269466 2648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33887 every 8 connection(s)
I20260811 01:32:19.270933 2499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:32:19.272847 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2499
I20260811 01:32:19.273069 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:32:19.273819 23711 external_mini_cluster.cc:1428] Setting key 36217c1cb4dbd893918a3e5d638f163f
I20260811 01:32:19.277199 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--builtin_ntp_servers=127.23.39.212:45161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:32:19.280627 2651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:19.273861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54925 (local address 127.23.39.254:43479)
0811 01:32:19.274421 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:19.274428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:19.275895 (+ 1467us) server_negotiation.cc:407] Connection header received
0811 01:32:19.277897 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:19.277906 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:19.277981 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:19.278113 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:19.279667 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:19.279676 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:19.279683 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:19.279709 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:19.279774 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:19.279795 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:19.279954 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:19.280123 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 01:32:19.280201 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":280,"threads_started":1}
I20260811 01:32:19.281558 2652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:19.274529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43479 (local address 127.23.39.193:54925)
0811 01:32:19.275703 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:19.275757 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:19.277598 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:19.278426 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:19.278435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:19.278535 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:19.279319 (+ 784us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:19.279321 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:19.279363 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:19.279458 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:19.279915 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:19.279922 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:19.279929 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:32:19.280159 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 01:32:19.280428 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":344,"threads_started":1}
I20260811 01:32:19.283398 2649 heartbeater.cc:347] Connected to a master server at 127.23.39.254:43479
I20260811 01:32:19.283803 2649 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:19.284608 2649 heartbeater.cc:511] Master 127.23.39.254:43479 requested a full tablet report, sending...
I20260811 01:32:19.287279 2433 ts_manager.cc:194] Registered new tserver with Master: b8faa00b185546d39cb5e735b98a4f9c (127.23.39.193:33887)
W20260811 01:32:19.648669 2653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:19.649063 2653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:19.649205 2653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:19.658870 2653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:19.658989 2653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:19.659188 2653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:32:19.673306 2653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:19.675300 2653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:19.678090 2653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:19.695145 2659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:19.695583 2658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:19.695897 2661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:19.696983 2653 server_base.cc:1034] running on GCE node
I20260811 01:32:19.697979 2653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:19.699512 2653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:19.700768 2653 hybrid_clock.cc:648] HybridClock initialized: now 1786411939700724 us; error 32 us; skew 500 ppm
I20260811 01:32:19.701190 2653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:19.704695 2653 webserver.cc:460] Webserver started at http://127.23.39.194:40551/ using document root <none> and password file <none>
I20260811 01:32:19.705753 2653 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:19.705896 2653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:19.706362 2653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:19.711174 2653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "d70ddcf568044368b61cdf849cf86033"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "36e69eac32ba3598c9dfbff2b5be1407"
server_key_iv: "e7ea91e4c0c2d20a8f53011fb0c90045"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.712673 2653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "d70ddcf568044368b61cdf849cf86033"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "36e69eac32ba3598c9dfbff2b5be1407"
server_key_iv: "e7ea91e4c0c2d20a8f53011fb0c90045"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.721675 2653 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260811 01:32:19.726042 2668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.728027 2653 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:32:19.728259 2653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "d70ddcf568044368b61cdf849cf86033"
format_stamp: "Formatted at 2026-08-11 01:32:19 on dist-test-slave-9jjr"
server_key: "36e69eac32ba3598c9dfbff2b5be1407"
server_key_iv: "e7ea91e4c0c2d20a8f53011fb0c90045"
server_key_version: "encryptionkey@0"
I20260811 01:32:19.728526 2653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:19.734802 2653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:19.735736 2653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:19.736039 2653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:19.737167 2653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:19.738793 2653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:19.738924 2653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.739058 2653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:19.739151 2653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:19.775130 2653 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:36341
I20260811 01:32:19.775225 2796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:36341 every 8 connection(s)
I20260811 01:32:19.776571 2653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:32:19.781795 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2653
I20260811 01:32:19.782008 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:32:19.782624 23711 external_mini_cluster.cc:1428] Setting key 1cccb48618901fb2e3f595d89f943e2d
I20260811 01:32:19.786320 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--builtin_ntp_servers=127.23.39.212:45161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 01:32:19.786625 2651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:19.779529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:51731 (local address 127.23.39.254:43479)
0811 01:32:19.779724 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:19.779728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:19.781213 (+ 1485us) server_negotiation.cc:407] Connection header received
0811 01:32:19.783900 (+ 2687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:19.783906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:19.784010 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:19.784122 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:19.785761 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:19.785769 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:19.785775 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:19.785804 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:19.785850 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:19.785867 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:19.786017 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:19.786224 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 01:32:19.786300 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:32:19.787849 2799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:19.780020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43479 (local address 127.23.39.194:51731)
0811 01:32:19.781011 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:19.781057 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:19.783496 (+ 2439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:19.784374 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:19.784383 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:19.784488 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:19.785410 (+ 922us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:19.785412 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:19.785454 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:19.785549 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:19.785975 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:19.785982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:19.785988 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:32:19.786299 (+ 311us) client_negotiation.cc:240] Negotiation successful
0811 01:32:19.786596 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":323,"threads_started":1}
I20260811 01:32:19.789565 2797 heartbeater.cc:347] Connected to a master server at 127.23.39.254:43479
I20260811 01:32:19.789904 2797 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:19.790603 2797 heartbeater.cc:511] Master 127.23.39.254:43479 requested a full tablet report, sending...
I20260811 01:32:19.792311 2433 ts_manager.cc:194] Registered new tserver with Master: d70ddcf568044368b61cdf849cf86033 (127.23.39.194:36341)
W20260811 01:32:20.164038 2800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:20.164354 2800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:20.164449 2800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:20.171954 2800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:20.172080 2800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:20.172197 2800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:32:20.181774 2800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:43479
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:20.183178 2800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:20.185067 2800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:20.199293 2805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:20.199357 2810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:20.199383 2807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:20.200423 2800 server_base.cc:1034] running on GCE node
I20260811 01:32:20.201161 2800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:20.202387 2800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:20.203613 2800 hybrid_clock.cc:648] HybridClock initialized: now 1786411940203572 us; error 42 us; skew 500 ppm
I20260811 01:32:20.204002 2800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:32:20.206650 2800 webserver.cc:460] Webserver started at http://127.23.39.195:35879/ using document root <none> and password file <none>
I20260811 01:32:20.207437 2800 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:20.207563 2800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:20.207926 2800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:20.211233 2800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "60abd46c7a8242e3a51173b7ac94d0d9"
format_stamp: "Formatted at 2026-08-11 01:32:20 on dist-test-slave-9jjr"
server_key: "8d720d63762e76ed19e4445d96ba850f"
server_key_iv: "e5c83d01ddd1899c9b132228f31a6018"
server_key_version: "encryptionkey@0"
I20260811 01:32:20.212288 2800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "60abd46c7a8242e3a51173b7ac94d0d9"
format_stamp: "Formatted at 2026-08-11 01:32:20 on dist-test-slave-9jjr"
server_key: "8d720d63762e76ed19e4445d96ba850f"
server_key_iv: "e5c83d01ddd1899c9b132228f31a6018"
server_key_version: "encryptionkey@0"
I20260811 01:32:20.218593 2800 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:32:20.223276 2818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:20.225065 2800 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:32:20.225306 2800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "60abd46c7a8242e3a51173b7ac94d0d9"
format_stamp: "Formatted at 2026-08-11 01:32:20 on dist-test-slave-9jjr"
server_key: "8d720d63762e76ed19e4445d96ba850f"
server_key_iv: "e5c83d01ddd1899c9b132228f31a6018"
server_key_version: "encryptionkey@0"
I20260811 01:32:20.225581 2800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:20.232324 2800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:20.233278 2800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:20.233532 2800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:20.234676 2800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:20.236327 2800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:20.236479 2800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:20.236624 2800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:20.236727 2800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:20.274191 2800 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:43647
I20260811 01:32:20.274251 2944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:43647 every 8 connection(s)
I20260811 01:32:20.276032 2800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:32:20.280481 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2800
I20260811 01:32:20.280721 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:32:20.281231 23711 external_mini_cluster.cc:1428] Setting key a75827495c045cc733ce6e77bc90af25
I20260811 01:32:20.286051 2651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:20.279031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:49611 (local address 127.23.39.254:43479)
0811 01:32:20.279238 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:20.279244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:20.280879 (+ 1635us) server_negotiation.cc:407] Connection header received
0811 01:32:20.283230 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:20.283235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:20.283322 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:20.283439 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:20.285258 (+ 1819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:20.285262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:20.285265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:20.285283 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:20.285318 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:20.285330 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:20.285459 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:20.285674 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 01:32:20.285752 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:32:20.287142 2947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:20.279605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43479 (local address 127.23.39.195:49611)
0811 01:32:20.280634 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:20.280706 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:20.282884 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:20.283789 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:20.283804 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:20.283954 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:20.284867 (+ 913us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:32:20.284873 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:20.284933 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:32:20.285033 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:20.285435 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:20.285447 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:20.285455 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 01:32:20.285782 (+ 327us) client_negotiation.cc:240] Negotiation successful
0811 01:32:20.286085 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":312,"threads_started":1}
I20260811 01:32:20.288895 2945 heartbeater.cc:347] Connected to a master server at 127.23.39.254:43479
I20260811 01:32:20.289247 2945 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:20.289952 2945 heartbeater.cc:511] Master 127.23.39.254:43479 requested a full tablet report, sending...
I20260811 01:32:20.290867 2649 heartbeater.cc:503] Master 127.23.39.254:43479 was elected leader, sending a full tablet report...
I20260811 01:32:20.291663 2433 ts_manager.cc:194] Registered new tserver with Master: 60abd46c7a8242e3a51173b7ac94d0d9 (127.23.39.195:43647)
I20260811 01:32:20.297619 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 01:32:20.304595 2651 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:32:20.302664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50958 (local address 127.23.39.254:43479)
0811 01:32:20.302857 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:20.302863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:20.303549 (+ 686us) server_negotiation.cc:407] Connection header received
0811 01:32:20.303683 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:20.303687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:20.303748 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:20.303848 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:20.304275 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50958: BlockingRecv error: recv got EOF from 127.0.0.1:50958 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:32:20.305596 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2499
I20260811 01:32:20.310039 2956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:20.306814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48188 (local address 127.23.39.193:33887)
0811 01:32:20.307417 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:20.307424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:20.307453 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:32:20.307524 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:20.307535 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:20.307770 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:20.307962 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:20.309208 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:20.309215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:20.309226 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:20.309240 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:20.309289 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:20.309304 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:20.309509 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:20.309581 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 01:32:20.309699 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":294,"threads_started":1}
I20260811 01:32:20.311570 2643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:20.399730 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2499
I20260811 01:32:20.420590 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2653
I20260811 01:32:20.424687 2958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:20.421719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48962 (local address 127.23.39.194:36341)
0811 01:32:20.422319 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:20.422326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:20.422356 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:32:20.422423 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:20.422429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:20.422658 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:20.422798 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:20.423904 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:20.423911 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:20.423924 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:20.423938 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:20.423990 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:20.424010 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:20.424176 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:20.424318 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 01:32:20.424413 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":280,"threads_started":1}
I20260811 01:32:20.426234 2792 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:20.512602 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2653
I20260811 01:32:20.533653 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2800
I20260811 01:32:20.538110 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:20.534775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59532 (local address 127.23.39.195:43647)
0811 01:32:20.535507 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:20.535514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:20.535549 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:32:20.535623 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:20.535629 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:20.535861 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:20.536050 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:20.537297 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:20.537304 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:20.537315 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:32:20.537332 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:20.537371 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:32:20.537385 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:20.537597 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:20.537678 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 01:32:20.537792 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":403,"threads_started":1}
I20260811 01:32:20.539664 2940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:20.626799 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2800
I20260811 01:32:20.647837 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2394
I20260811 01:32:20.649242 2468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:20.795747 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2394
2026-08-11T01:32:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2742 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:32:20 dist-test-slave-9jjr krb5kdc[2968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:32:20 dist-test-slave-9jjr krb5kdc[2968](info): set up 2 sockets
Aug 11 01:32:20 dist-test-slave-9jjr krb5kdc[2968](info): commencing operation
krb5kdc: starting...
W20260811 01:32:22.098628 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.007s sys 0.068s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:32:22 dist-test-slave-9jjr krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:32:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:32:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:32:22.435281 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34595
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:34595
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:32:22.809082 2982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:22.809496 2982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:22.809662 2982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:22.817448 2982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:32:22.817657 2982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:22.817786 2982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:22.817902 2982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:32:22.817983 2982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:32:22.829031 2982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:34595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:22.830603 2982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:22.832113 2982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:22.845466 2991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:22.845551 2989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:22.845443 2987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:22.848059 2982 server_base.cc:1034] running on GCE node
I20260811 01:32:22.849041 2982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:22.850850 2982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:22.852159 2982 hybrid_clock.cc:648] HybridClock initialized: now 1786411942852112 us; error 64 us; skew 500 ppm
I20260811 01:32:22.852610 2982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:32:22 dist-test-slave-9jjr krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:32:22.861004 2982 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:32:22.864096 2982 webserver.cc:460] Webserver started at http://127.23.39.254:42779/ using document root <none> and password file <none>
I20260811 01:32:22.865054 2982 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:22.865267 2982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:22.865658 2982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:22.869393 2982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2"
format_stamp: "Formatted at 2026-08-11 01:32:22 on dist-test-slave-9jjr"
server_key: "3a0afe0ea20d188417f95bc94519c598"
server_key_iv: "90c4d7b974d4c9e83f8c8f8cb5ee6792"
server_key_version: "encryptionkey@0"
I20260811 01:32:22.870514 2982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2"
format_stamp: "Formatted at 2026-08-11 01:32:22 on dist-test-slave-9jjr"
server_key: "3a0afe0ea20d188417f95bc94519c598"
server_key_iv: "90c4d7b974d4c9e83f8c8f8cb5ee6792"
server_key_version: "encryptionkey@0"
I20260811 01:32:22.876660 2982 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:32:22.880822 3001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:22.882606 2982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:32:22.882836 2982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2"
format_stamp: "Formatted at 2026-08-11 01:32:22 on dist-test-slave-9jjr"
server_key: "3a0afe0ea20d188417f95bc94519c598"
server_key_iv: "90c4d7b974d4c9e83f8c8f8cb5ee6792"
server_key_version: "encryptionkey@0"
I20260811 01:32:22.883091 2982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:22.900835 2982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:22.905658 2982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:22.905995 2982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:22.926746 2982 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:34595
I20260811 01:32:22.926797 3061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:34595 every 8 connection(s)
I20260811 01:32:22.928306 2982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:32:22.930325 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 2982
I20260811 01:32:22.930583 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:32:22.931288 23711 external_mini_cluster.cc:1428] Setting key 1020d424882732ae3dd371e36f33efb2
I20260811 01:32:22.933236 3063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:32:22 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:32:22.949687 3063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: Bootstrap starting.
I20260811 01:32:22.953815 3063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:22.955132 3063 log.cc:824] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:22.958447 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:22.933560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36458 (local address 127.23.39.254:34595)
0811 01:32:22.934470 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:22.934482 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:22.934524 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:32:22.936270 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:22.936302 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:22.936759 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:22.937140 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:22.939455 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:22.941035 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:22.943171 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:22.944008 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:22.944193 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:22.949767 (+ 5574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:22.949778 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:22.949802 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:22.949890 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:22.953413 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:22.954610 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:22.954619 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:22.954626 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:22.954838 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:22.955323 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:22.955330 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:22.955333 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:22.955973 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:22.956338 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:22.956842 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 01:32:22.957299 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":394,"threads_started":1}
I20260811 01:32:22.958660 3063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: No bootstrap required, opened a new log
I20260811 01:32:22.967016 3063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } }
I20260811 01:32:22.967736 3063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:22.967900 3063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 231f19cc5b0d44f5ab2fe7598ef0d3c2, State: Initialized, Role: FOLLOWER
I20260811 01:32:22.968617 3063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } }
I20260811 01:32:22.968900 3063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:32:22.969059 3063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:32:22.969291 3063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:22.971700 3063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } }
I20260811 01:32:22.972314 3063 leader_election.cc:302] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 231f19cc5b0d44f5ab2fe7598ef0d3c2; no voters:
I20260811 01:32:22.973105 3063 leader_election.cc:288] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:32:22.973240 3068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:32:22.974030 3068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [term 1 LEADER]: Becoming Leader. State: Replica: 231f19cc5b0d44f5ab2fe7598ef0d3c2, State: Running, Role: LEADER
I20260811 01:32:22.974673 3068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } }
I20260811 01:32:22.975564 3063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:32:22.977820 3069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } } }
I20260811 01:32:22.977936 3070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 231f19cc5b0d44f5ab2fe7598ef0d3c2. Latest consensus state: current_term: 1 leader_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231f19cc5b0d44f5ab2fe7598ef0d3c2" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34595 } } }
I20260811 01:32:22.978381 3069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:22.978395 3070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2 [sys.catalog]: This master's current role is: LEADER
I20260811 01:32:22.979590 3079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:32:22.985219 3079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:32:22.995139 3079 catalog_manager.cc:1347] Generated new cluster ID: 6033950afa404654a20c01aeb42837c9
I20260811 01:32:22.995303 3079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:32:23.011077 3079 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:32:23.013273 3079 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:32:23.022431 3079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: Generated new TSK 0
I20260811 01:32:23.023798 3079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:32:23.111706 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:32:23.474337 3091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:23.474637 3091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:23.474735 3091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:23.482331 3091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:23.482443 3091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:23.482558 3091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:32:23.492643 3091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:23.493932 3091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:23.495302 3091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:23.509294 3097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:23.509336 3099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:23.509358 3096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:23.510494 3091 server_base.cc:1034] running on GCE node
I20260811 01:32:23.511238 3091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:23.512324 3091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:23.513615 3091 hybrid_clock.cc:648] HybridClock initialized: now 1786411943513555 us; error 48 us; skew 500 ppm
I20260811 01:32:23.513993 3091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:32:23 dist-test-slave-9jjr krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411943, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:32:23.517542 3091 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:32:23.519224 3091 webserver.cc:460] Webserver started at http://127.23.39.193:34151/ using document root <none> and password file <none>
I20260811 01:32:23.519974 3091 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:23.520094 3091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:23.520370 3091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:23.523691 3091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "bf3976e356d240ca82182f1341f3c6eb"
format_stamp: "Formatted at 2026-08-11 01:32:23 on dist-test-slave-9jjr"
server_key: "ab7bf54a2d88d35a3b5141fd7465adbd"
server_key_iv: "187ad050f8ac18caff12cbf3abd4b140"
server_key_version: "encryptionkey@0"
I20260811 01:32:23.524487 3091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "bf3976e356d240ca82182f1341f3c6eb"
format_stamp: "Formatted at 2026-08-11 01:32:23 on dist-test-slave-9jjr"
server_key: "ab7bf54a2d88d35a3b5141fd7465adbd"
server_key_iv: "187ad050f8ac18caff12cbf3abd4b140"
server_key_version: "encryptionkey@0"
I20260811 01:32:23.530274 3091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 01:32:23.534288 3106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:23.535861 3091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:32:23.536108 3091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "bf3976e356d240ca82182f1341f3c6eb"
format_stamp: "Formatted at 2026-08-11 01:32:23 on dist-test-slave-9jjr"
server_key: "ab7bf54a2d88d35a3b5141fd7465adbd"
server_key_iv: "187ad050f8ac18caff12cbf3abd4b140"
server_key_version: "encryptionkey@0"
I20260811 01:32:23.536347 3091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:23.555197 3091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:23.560139 3091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:23.560503 3091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:23.561585 3091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:23.563195 3091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:23.563308 3091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:23.563468 3091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:23.563542 3091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:23.599299 3091 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:38083
I20260811 01:32:23.599341 3237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:38083 every 8 connection(s)
I20260811 01:32:23.600781 3091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:32:23.604760 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 3091
I20260811 01:32:23.605015 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:32:23.605808 23711 external_mini_cluster.cc:1428] Setting key 8151df6007a2f970117b6bd75e4f8797
Aug 11 01:32:23 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411943, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:32:23.623525 3241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:23.603732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:50231 (local address 127.23.39.254:34595)
0811 01:32:23.604234 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:23.604239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:23.605284 (+ 1045us) server_negotiation.cc:407] Connection header received
0811 01:32:23.607526 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:23.607532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:23.607638 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:23.607776 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:23.609405 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:23.610252 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:23.612322 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:23.612765 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:23.612920 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:23.617078 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:23.617084 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:23.617087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:23.617126 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:23.619930 (+ 2804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:23.620829 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:23.620834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:23.620836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:23.620979 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:23.621555 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:23.621558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:23.621560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:23.621873 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:23.621995 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:23.623033 (+ 1038us) server_negotiation.cc:299] Negotiation successful
0811 01:32:23.623254 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":259,"threads_started":1}
I20260811 01:32:23.625238 3243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:23.604186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34595 (local address 127.23.39.193:50231)
0811 01:32:23.605099 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:23.605157 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:23.607224 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:23.608032 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:23.608041 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:23.608598 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:23.609197 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:23.609215 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:23.610445 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:23.610449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:23.612092 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:23.612108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:23.613024 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:23.613031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:23.613306 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:23.614080 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:23.614105 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:23.616788 (+ 2683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:23.620115 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:23.620125 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:23.620159 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:23.620640 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:23.621106 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:23.621112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:23.621117 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:23.621422 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:23.622016 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:23.622027 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:23.622573 (+ 546us) client_negotiation.cc:769] Sending connection context
0811 01:32:23.622916 (+ 343us) client_negotiation.cc:240] Negotiation successful
0811 01:32:23.623584 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":346,"threads_started":1}
I20260811 01:32:23.627209 3238 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34595
I20260811 01:32:23.627586 3238 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:23.628432 3238 heartbeater.cc:511] Master 127.23.39.254:34595 requested a full tablet report, sending...
I20260811 01:32:23.631081 3020 ts_manager.cc:194] Registered new tserver with Master: bf3976e356d240ca82182f1341f3c6eb (127.23.39.193:38083)
I20260811 01:32:23.633009 3020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:50231
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:32:23.678423 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:32:24.054062 3246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:24.054525 3246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:24.054695 3246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:32:24.062603 3246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:24.062775 3246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:24.062965 3246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:32:24.073450 3246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:24.075079 3246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:24.076731 3246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:24.091434 3251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:24.091483 3255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:24.091677 3253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:24.092554 3246 server_base.cc:1034] running on GCE node
I20260811 01:32:24.093218 3246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:24.094323 3246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:24.095590 3246 hybrid_clock.cc:648] HybridClock initialized: now 1786411944095510 us; error 49 us; skew 500 ppm
I20260811 01:32:24.095979 3246 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:32:24 dist-test-slave-9jjr krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:32:24.099588 3246 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:32:24.101332 3246 webserver.cc:460] Webserver started at http://127.23.39.194:42933/ using document root <none> and password file <none>
I20260811 01:32:24.102078 3246 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:24.102274 3246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:24.102618 3246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:24.105999 3246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "38256405afa94b768be9dfbc376d88e3"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "523af659b89fbaaddd9d53a70581e053"
server_key_iv: "179b52221dec0aebed008aded173d477"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.106912 3246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "38256405afa94b768be9dfbc376d88e3"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "523af659b89fbaaddd9d53a70581e053"
server_key_iv: "179b52221dec0aebed008aded173d477"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.112916 3246 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260811 01:32:24.117115 3262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.118937 3246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:32:24.119168 3246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "38256405afa94b768be9dfbc376d88e3"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "523af659b89fbaaddd9d53a70581e053"
server_key_iv: "179b52221dec0aebed008aded173d477"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.119410 3246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:24.137943 3246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:24.143585 3246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:24.143986 3246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:24.145188 3246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:24.146896 3246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:24.147038 3246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.147231 3246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:24.147313 3246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.186654 3246 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:39611
I20260811 01:32:24.186761 3398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:39611 every 8 connection(s)
I20260811 01:32:24.188344 3246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:32:24.193161 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 3246
I20260811 01:32:24.193393 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:32:24.193871 23711 external_mini_cluster.cc:1428] Setting key 7810dc7392b59087f7b7798d2fabca79
Aug 11 01:32:24 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:32:24.210909 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.191310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:42885 (local address 127.23.39.254:34595)
0811 01:32:24.191856 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.191861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.192754 (+ 893us) server_negotiation.cc:407] Connection header received
0811 01:32:24.194998 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.195005 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.195125 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.195262 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:24.197231 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.198049 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.199789 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.200262 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.200411 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.204394 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:24.204400 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:24.204403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:24.204443 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:24.207378 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.208251 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.208259 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.208263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.208423 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.208927 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.208932 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.208937 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.209249 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:24.209419 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.210246 (+ 827us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.210507 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":299,"threads_started":1}
I20260811 01:32:24.211998 3402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.191781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34595 (local address 127.23.39.194:42885)
0811 01:32:24.192542 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:24.192588 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:24.194627 (+ 2039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:24.195613 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:24.195623 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:24.196393 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:24.197034 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.197054 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.198278 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.198282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.199606 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.199621 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.200540 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.200547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.200817 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.201602 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:24.201628 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:24.204085 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:24.207570 (+ 3485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:24.207581 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:24.207601 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:24.208105 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:24.208551 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:24.208556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:24.208560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:24.208797 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:24.209393 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:24.209402 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:24.209827 (+ 425us) client_negotiation.cc:769] Sending connection context
0811 01:32:24.210125 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 01:32:24.210766 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":284,"threads_started":1}
I20260811 01:32:24.213711 3399 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34595
I20260811 01:32:24.214093 3399 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:24.215090 3399 heartbeater.cc:511] Master 127.23.39.254:34595 requested a full tablet report, sending...
I20260811 01:32:24.217051 3020 ts_manager.cc:194] Registered new tserver with Master: 38256405afa94b768be9dfbc376d88e3 (127.23.39.194:39611)
I20260811 01:32:24.218441 3020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:42885
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:32:24.270476 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:32:24.636574 3405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:32:24.636914 3405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:32:24.637095 3405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 01:32:24.637238 3238 heartbeater.cc:503] Master 127.23.39.254:34595 was elected leader, sending a full tablet report...
W20260811 01:32:24.645833 3405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:32:24.645974 3405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:32:24.646205 3405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:32:24.656821 3405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34595
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:32:24.658834 3405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:32:24.660890 3405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:32:24.677062 3410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:24.676999 3411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:32:24.677039 3413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:32:24.678687 3405 server_base.cc:1034] running on GCE node
I20260811 01:32:24.679587 3405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:32:24.680788 3405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:32:24.682025 3405 hybrid_clock.cc:648] HybridClock initialized: now 1786411944681967 us; error 50 us; skew 500 ppm
I20260811 01:32:24.682456 3405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:32:24 dist-test-slave-9jjr krb5kdc[2968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:32:24.686312 3405 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:32:24.688150 3405 webserver.cc:460] Webserver started at http://127.23.39.195:33395/ using document root <none> and password file <none>
I20260811 01:32:24.689010 3405 fs_manager.cc:359] Metadata directory not provided
I20260811 01:32:24.689167 3405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:32:24.689515 3405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:32:24.693392 3405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "8750b5864e1945b79fe748cefd367fe5"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "ef4b48c5100a4d88a03fffb132d82aed"
server_key_iv: "3eb11852e01f667b6a625de1f7a249f7"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.694519 3405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "8750b5864e1945b79fe748cefd367fe5"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "ef4b48c5100a4d88a03fffb132d82aed"
server_key_iv: "3eb11852e01f667b6a625de1f7a249f7"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.700651 3405 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:32:24.704735 3420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.706571 3405 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:32:24.706790 3405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "8750b5864e1945b79fe748cefd367fe5"
format_stamp: "Formatted at 2026-08-11 01:32:24 on dist-test-slave-9jjr"
server_key: "ef4b48c5100a4d88a03fffb132d82aed"
server_key_iv: "3eb11852e01f667b6a625de1f7a249f7"
server_key_version: "encryptionkey@0"
I20260811 01:32:24.707033 3405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:32:24.759146 3405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:32:24.763896 3405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:32:24.764271 3405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:32:24.765383 3405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:32:24.766971 3405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:32:24.767103 3405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.767277 3405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:32:24.767359 3405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:32:24.804261 3405 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:34991
I20260811 01:32:24.804315 3553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:34991 every 8 connection(s)
I20260811 01:32:24.805670 3405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:32:24.816037 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 3405
I20260811 01:32:24.816277 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:32:24.816749 23711 external_mini_cluster.cc:1428] Setting key c56162ef3a2067a28a15d59b18f200c7
Aug 11 01:32:24 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411944, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:32:24.828979 3556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.808476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46123 (local address 127.23.39.254:34595)
0811 01:32:24.808993 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.808997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.810023 (+ 1026us) server_negotiation.cc:407] Connection header received
0811 01:32:24.812285 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.812292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.812415 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.812551 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:24.814328 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.815150 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.817100 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.817916 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.818100 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.822620 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:24.822625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:24.822629 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:24.822671 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:24.825648 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.826631 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.826636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.826638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.826814 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.827274 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.827277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.827279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.827578 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:24.827698 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.828477 (+ 779us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.828675 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":240,"threads_started":1}
I20260811 01:32:24.830081 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.809049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34595 (local address 127.23.39.195:46123)
0811 01:32:24.809831 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:24.809880 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:24.811919 (+ 2039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:24.812836 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:24.812845 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:24.813417 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:32:24.814062 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.814081 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.815348 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.815353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.816926 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.816942 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.818291 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.818299 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.818699 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.819581 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:32:24.819615 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:32:24.822314 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:32:24.825833 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:24.825841 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:24.825858 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:24.826493 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:24.826918 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:32:24.826921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:32:24.826923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:32:24.827154 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:32:24.827694 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:32:24.827700 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:32:24.828078 (+ 378us) client_negotiation.cc:769] Sending connection context
0811 01:32:24.828356 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 01:32:24.828824 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":315,"threads_started":1}
I20260811 01:32:24.831774 3554 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34595
I20260811 01:32:24.832125 3554 heartbeater.cc:464] Registering TS with master...
I20260811 01:32:24.832943 3554 heartbeater.cc:511] Master 127.23.39.254:34595 requested a full tablet report, sending...
I20260811 01:32:24.834681 3020 ts_manager.cc:194] Registered new tserver with Master: 8750b5864e1945b79fe748cefd367fe5 (127.23.39.195:34991)
I20260811 01:32:24.835559 3020 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:46123
I20260811 01:32:24.846469 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:32:24.869596 3556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.851836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36460 (local address 127.23.39.254:34595)
0811 01:32:24.852581 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.852589 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.852613 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:32:24.852758 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.852764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.852862 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.852983 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:24.855301 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.856846 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.859197 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.860005 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.860119 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.863280 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:24.863286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:24.863290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:24.863338 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:24.866596 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.867493 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.867498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.867500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.867645 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:24.868009 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:24.868013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:24.868015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:24.868435 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:24.868642 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.869028 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.869223 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569}
I20260811 01:32:24.874940 3020 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:32:24.882835 3020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:32:24.925725 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.900173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32858 (local address 127.23.39.194:39611)
0811 01:32:24.915067 (+ 14894us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.915079 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.916285 (+ 1206us) server_negotiation.cc:407] Connection header received
0811 01:32:24.916424 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.916431 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.916644 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.916844 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:32:24.918024 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.919269 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.922257 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.923934 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924106 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.924356 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.925129 (+ 773us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.925342 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14734,"thread_start_us":14608,"threads_started":1}
I20260811 01:32:24.925912 3568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.899847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39611 (local address 127.0.0.1:32858)
0811 01:32:24.915973 (+ 16126us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:24.915991 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:24.916123 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:24.917117 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:24.917122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:24.917149 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:32:24.917842 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.917853 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.919490 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.919496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.922013 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.922032 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.924515 (+ 2483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.924796 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.924874 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 01:32:24.925030 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 01:32:24.925268 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16000,"mutex_wait_us":169,"thread_start_us":15408,"threads_started":1}
I20260811 01:32:24.926149 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.897531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.23.39.195:34991)
0811 01:32:24.914348 (+ 16817us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.914360 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.916039 (+ 1679us) server_negotiation.cc:407] Connection header received
0811 01:32:24.916149 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.916159 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.916407 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.916612 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:32:24.918083 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.919821 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.922769 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.924233 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924451 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.924697 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.925553 (+ 856us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.925742 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16557,"thread_start_us":16348,"threads_started":1}
I20260811 01:32:24.926477 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.897088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34991 (local address 127.0.0.1:42488)
0811 01:32:24.915684 (+ 18596us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:24.915707 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:24.915888 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:24.916969 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:24.916974 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:24.917025 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:32:24.917804 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.917827 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.920016 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.920022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.922554 (+ 2532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.922563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.924887 (+ 2324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.925094 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.925129 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 01:32:24.925218 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:32:24.925387 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18404,"mutex_wait_us":192,"spinlock_wait_cycles":7296,"thread_start_us":17364,"threads_started":1}
I20260811 01:32:24.927104 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.896958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:38083 (local address 127.0.0.1:46008)
0811 01:32:24.914910 (+ 17952us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:24.914965 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:24.915229 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:24.916762 (+ 1533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:24.916773 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:24.916811 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:32:24.917454 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.917469 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.919684 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.919692 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.922543 (+ 2851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:24.922560 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.924825 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:24.925027 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.926412 (+ 1385us) client_negotiation.cc:769] Sending connection context
0811 01:32:24.926513 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 01:32:24.926650 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17665,"mutex_wait_us":1510,"spinlock_wait_cycles":6912,"thread_start_us":18662,"threads_started":1}
I20260811 01:32:24.927840 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:24.897356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46008 (local address 127.23.39.193:38083)
0811 01:32:24.913624 (+ 16268us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:24.913638 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:24.915432 (+ 1794us) server_negotiation.cc:407] Connection header received
0811 01:32:24.915835 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:24.915846 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:24.916148 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:24.916390 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:32:24.917699 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.919500 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.922765 (+ 3265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:24.924374 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:24.924529 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:24.925239 (+ 710us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:24.927340 (+ 2101us) server_negotiation.cc:299] Negotiation successful
0811 01:32:24.927529 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16000,"thread_start_us":17023,"threads_started":1}
I20260811 01:32:24.930513 3481 tablet_service.cc:1467] Processing CreateTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 (DEFAULT_TABLE table=test-table [id=28ce802f43814e52bbf3fe6390a69fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:32:24.930662 3322 tablet_service.cc:1467] Processing CreateTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 (DEFAULT_TABLE table=test-table [id=28ce802f43814e52bbf3fe6390a69fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:32:24.932318 3481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d29c06fe4b438daea25b0b23b0b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:32:24.932513 3322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d29c06fe4b438daea25b0b23b0b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:32:24.933627 3163 tablet_service.cc:1467] Processing CreateTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 (DEFAULT_TABLE table=test-table [id=28ce802f43814e52bbf3fe6390a69fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:32:24.935097 3163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d29c06fe4b438daea25b0b23b0b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:32:24.953609 3580 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Bootstrap starting.
I20260811 01:32:24.956343 3578 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Bootstrap starting.
I20260811 01:32:24.957702 3579 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Bootstrap starting.
I20260811 01:32:24.959715 3580 tablet_bootstrap.cc:654] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:24.960886 3580 log.cc:824] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:24.962065 3578 tablet_bootstrap.cc:654] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:24.962069 3579 tablet_bootstrap.cc:654] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Neither blocks nor log segments found. Creating new log.
I20260811 01:32:24.963539 3579 log.cc:824] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:24.963542 3578 log.cc:824] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:32:24.964046 3580 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: No bootstrap required, opened a new log
I20260811 01:32:24.964380 3580 ts_tablet_manager.cc:1397] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260811 01:32:24.967141 3578 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: No bootstrap required, opened a new log
I20260811 01:32:24.967370 3579 tablet_bootstrap.cc:492] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: No bootstrap required, opened a new log
I20260811 01:32:24.967464 3578 ts_tablet_manager.cc:1397] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:32:24.967751 3579 ts_tablet_manager.cc:1397] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:32:24.975293 3578 raft_consensus.cc:348] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.975867 3578 raft_consensus.cc:374] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:24.975991 3578 raft_consensus.cc:729] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8750b5864e1945b79fe748cefd367fe5, State: Initialized, Role: FOLLOWER
I20260811 01:32:24.976001 3580 raft_consensus.cc:348] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.976456 3580 raft_consensus.cc:374] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:24.976563 3580 raft_consensus.cc:729] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38256405afa94b768be9dfbc376d88e3, State: Initialized, Role: FOLLOWER
I20260811 01:32:24.976774 3578 consensus_queue.cc:260] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.977186 3580 consensus_queue.cc:260] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.979326 3579 raft_consensus.cc:348] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.979905 3579 raft_consensus.cc:374] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:32:24.980032 3579 raft_consensus.cc:729] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf3976e356d240ca82182f1341f3c6eb, State: Initialized, Role: FOLLOWER
I20260811 01:32:24.980749 3554 heartbeater.cc:503] Master 127.23.39.254:34595 was elected leader, sending a full tablet report...
I20260811 01:32:24.980810 3579 consensus_queue.cc:260] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:24.981304 3578 ts_tablet_manager.cc:1428] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260811 01:32:24.982535 3399 heartbeater.cc:503] Master 127.23.39.254:34595 was elected leader, sending a full tablet report...
I20260811 01:32:24.983311 3580 ts_tablet_manager.cc:1428] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Time spent starting tablet: real 0.019s user 0.005s sys 0.014s
I20260811 01:32:24.985154 3579 ts_tablet_manager.cc:1428] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260811 01:32:25.031311 3590 raft_consensus.cc:482] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:32:25.031662 3590 raft_consensus.cc:504] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:25.033492 3590 leader_election.cc:288] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf3976e356d240ca82182f1341f3c6eb (127.23.39.193:38083), 38256405afa94b768be9dfbc376d88e3 (127.23.39.194:39611)
I20260811 01:32:25.039531 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.033845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:38083 (local address 127.23.39.195:51585)
0811 01:32:25.034081 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:25.034103 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:25.034302 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:25.034719 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:25.034724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:25.034772 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:32:25.034984 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:25.034994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.036075 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.036084 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:25.037421 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:25.037439 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.038715 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.038722 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:25.038926 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.038951 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:32:25.039067 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:32:25.039218 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:32:25.039510 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.034181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:51585 (local address 127.23.39.193:38083)
0811 01:32:25.034444 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.034449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.034465 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:32:25.034528 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.034531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.034586 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.034694 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:32:25.035143 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.035916 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.037621 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.038521 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.038715 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.038796 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.039097 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.039233 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 01:32:25.040508 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.034063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:60445 (local address 127.23.39.194:39611)
0811 01:32:25.034321 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.034328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.035148 (+ 820us) server_negotiation.cc:407] Connection header received
0811 01:32:25.035356 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.035361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.035422 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.035527 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:32:25.036106 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.036827 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.038712 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.039536 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.039740 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.039813 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.040092 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.040242 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 01:32:25.040601 3594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.033845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39611 (local address 127.23.39.195:60445)
0811 01:32:25.035024 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0811 01:32:25.035040 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:32:25.035196 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:32:25.035550 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:32:25.035555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:32:25.035582 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:32:25.035936 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:25.035945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.037003 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.037016 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:25.038527 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:32:25.038540 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.039767 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.039774 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:32:25.039931 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.039954 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:32:25.040063 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:32:25.040197 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":422,"thread_start_us":371,"threads_started":1}
I20260811 01:32:25.041086 3188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33d29c06fe4b438daea25b0b23b0b5e3" candidate_uuid: "8750b5864e1945b79fe748cefd367fe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf3976e356d240ca82182f1341f3c6eb" is_pre_election: true
I20260811 01:32:25.041818 3188 raft_consensus.cc:2454] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8750b5864e1945b79fe748cefd367fe5 in term 0.
I20260811 01:32:25.041770 3350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33d29c06fe4b438daea25b0b23b0b5e3" candidate_uuid: "8750b5864e1945b79fe748cefd367fe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38256405afa94b768be9dfbc376d88e3" is_pre_election: true
I20260811 01:32:25.042351 3350 raft_consensus.cc:2454] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8750b5864e1945b79fe748cefd367fe5 in term 0.
I20260811 01:32:25.042701 3422 leader_election.cc:302] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8750b5864e1945b79fe748cefd367fe5, bf3976e356d240ca82182f1341f3c6eb; no voters:
I20260811 01:32:25.043208 3590 raft_consensus.cc:2781] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:32:25.043372 3590 raft_consensus.cc:482] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:32:25.043491 3590 raft_consensus.cc:3037] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:25.045867 3590 raft_consensus.cc:504] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:25.046634 3590 leader_election.cc:288] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [CANDIDATE]: Term 1 election: Requested vote from peers bf3976e356d240ca82182f1341f3c6eb (127.23.39.193:38083), 38256405afa94b768be9dfbc376d88e3 (127.23.39.194:39611)
I20260811 01:32:25.047169 3188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33d29c06fe4b438daea25b0b23b0b5e3" candidate_uuid: "8750b5864e1945b79fe748cefd367fe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf3976e356d240ca82182f1341f3c6eb"
I20260811 01:32:25.047240 3350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33d29c06fe4b438daea25b0b23b0b5e3" candidate_uuid: "8750b5864e1945b79fe748cefd367fe5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38256405afa94b768be9dfbc376d88e3"
I20260811 01:32:25.047396 3188 raft_consensus.cc:3037] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:25.047492 3350 raft_consensus.cc:3037] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:32:25.050004 3350 raft_consensus.cc:2454] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8750b5864e1945b79fe748cefd367fe5 in term 1.
I20260811 01:32:25.050026 3188 raft_consensus.cc:2454] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8750b5864e1945b79fe748cefd367fe5 in term 1.
I20260811 01:32:25.050558 3425 leader_election.cc:302] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38256405afa94b768be9dfbc376d88e3, 8750b5864e1945b79fe748cefd367fe5; no voters:
I20260811 01:32:25.050959 3590 raft_consensus.cc:2781] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:32:25.051506 3590 raft_consensus.cc:686] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 1 LEADER]: Becoming Leader. State: Replica: 8750b5864e1945b79fe748cefd367fe5, State: Running, Role: LEADER
I20260811 01:32:25.052030 3590 consensus_queue.cc:237] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } }
I20260811 01:32:25.056865 3018 catalog_manager.cc:5495] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8750b5864e1945b79fe748cefd367fe5 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "8750b5864e1945b79fe748cefd367fe5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8750b5864e1945b79fe748cefd367fe5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 } health_report { overall_health: UNKNOWN } } }
W20260811 01:32:25.057416 3555 tablet.cc:2369] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:32:25.096498 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.091289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42490 (local address 127.23.39.195:34991)
0811 01:32:25.091485 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.091490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.091509 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:32:25.091706 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.091710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.091803 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.091939 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:32:25.092314 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.093021 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.094381 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.094784 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.094880 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.095396 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:32:25.095943 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:32:25.096056 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.096190 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.096267 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 01:32:25.103750 3240 tablet.cc:2369] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:32:25.105731 3188 raft_consensus.cc:1261] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 1 FOLLOWER]: Refusing update from remote peer 8750b5864e1945b79fe748cefd367fe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:32:25.105728 3350 raft_consensus.cc:1261] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 1 FOLLOWER]: Refusing update from remote peer 8750b5864e1945b79fe748cefd367fe5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:32:25.107012 3595 consensus_queue.cc:1035] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf3976e356d240ca82182f1341f3c6eb" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 38083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:32:25.107434 3590 consensus_queue.cc:1035] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38256405afa94b768be9dfbc376d88e3" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:32:25.118758 3598 mvcc.cc:205] Tried to move back new op lower bound from 7317143327140425728 to 7317143326937935872. Current Snapshot: MvccSnapshot[applied={T|T < 7317143327140425728}]
I20260811 01:32:25.124686 3599 mvcc.cc:205] Tried to move back new op lower bound from 7317143327140425728 to 7317143326937935872. Current Snapshot: MvccSnapshot[applied={T|T < 7317143327140425728 or (T in {7317143327140425728})}]
I20260811 01:32:25.137552 3018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:32:25.137902 3018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:32:25.142020 3018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 231f19cc5b0d44f5ab2fe7598ef0d3c2: Sending DeleteTablet for 3 replicas of tablet 33d29c06fe4b438daea25b0b23b0b5e3
I20260811 01:32:25.143425 3163 tablet_service.cc:1514] Processing DeleteTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:32:25 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:46008
I20260811 01:32:25.143481 3481 tablet_service.cc:1514] Processing DeleteTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:32:25 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:42488
I20260811 01:32:25.143566 3322 tablet_service.cc:1514] Processing DeleteTablet for tablet 33d29c06fe4b438daea25b0b23b0b5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:32:25 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:32858
I20260811 01:32:25.145961 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 3091
I20260811 01:32:25.160693 3611 tablet_replica.cc:330] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: stopping tablet replica
I20260811 01:32:25.160980 3610 tablet_replica.cc:330] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: stopping tablet replica
I20260811 01:32:25.161273 3611 raft_consensus.cc:2229] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:32:25.161442 3610 raft_consensus.cc:2229] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:32:25.161865 3611 raft_consensus.cc:2258] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:32:25.161990 3610 raft_consensus.cc:2258] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:32:25.162878 3609 tablet_replica.cc:330] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: stopping tablet replica
I20260811 01:32:25.163376 3609 raft_consensus.cc:2229] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:32:25.164137 3609 raft_consensus.cc:2258] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:32:25.164759 3611 ts_tablet_manager.cc:1905] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:32:25.165331 3610 ts_tablet_manager.cc:1905] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:32:25.166316 3609 ts_tablet_manager.cc:1905] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:32:25.172446 3611 ts_tablet_manager.cc:1918] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:32:25.172644 3611 log.cc:1196] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/33d29c06fe4b438daea25b0b23b0b5e3
I20260811 01:32:25.173228 3611 ts_tablet_manager.cc:1939] T 33d29c06fe4b438daea25b0b23b0b5e3 P 38256405afa94b768be9dfbc376d88e3: Deleting consensus metadata
I20260811 01:32:25.175202 3609 ts_tablet_manager.cc:1918] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:32:25.175412 3609 log.cc:1196] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/33d29c06fe4b438daea25b0b23b0b5e3
I20260811 01:32:25.175743 3004 catalog_manager.cc:4841] TS 38256405afa94b768be9dfbc376d88e3 (127.23.39.194:39611): tablet 33d29c06fe4b438daea25b0b23b0b5e3 (table test-table [id=28ce802f43814e52bbf3fe6390a69fa4]) successfully deleted
I20260811 01:32:25.176105 3609 ts_tablet_manager.cc:1939] T 33d29c06fe4b438daea25b0b23b0b5e3 P 8750b5864e1945b79fe748cefd367fe5: Deleting consensus metadata
I20260811 01:32:25.178298 3003 catalog_manager.cc:4841] TS 8750b5864e1945b79fe748cefd367fe5 (127.23.39.195:34991): tablet 33d29c06fe4b438daea25b0b23b0b5e3 (table test-table [id=28ce802f43814e52bbf3fe6390a69fa4]) successfully deleted
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:32:25.181066 3610 ts_tablet_manager.cc:1918] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:32:25.181277 3610 log.cc:1196] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/33d29c06fe4b438daea25b0b23b0b5e3
I20260811 01:32:25.181891 3610 ts_tablet_manager.cc:1939] T 33d29c06fe4b438daea25b0b23b0b5e3 P bf3976e356d240ca82182f1341f3c6eb: Deleting consensus metadata
I20260811 01:32:25.183885 3002 catalog_manager.cc:4841] TS bf3976e356d240ca82182f1341f3c6eb (127.23.39.193:38083): tablet 33d29c06fe4b438daea25b0b23b0b5e3 (table test-table [id=28ce802f43814e52bbf3fe6390a69fa4]) successfully deleted
I20260811 01:32:25.188858 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.148102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46012 (local address 127.23.39.193:38083)
0811 01:32:25.148369 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.148378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.157330 (+ 8952us) server_negotiation.cc:407] Connection header received
0811 01:32:25.157541 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.157551 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.157690 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.157844 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:25.165582 (+ 7738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.166732 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.172750 (+ 6018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.173446 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.173557 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.180314 (+ 6757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:25.180335 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:25.180356 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:25.180408 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:25.184907 (+ 4499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.185804 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.185814 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.185818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.186002 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.186577 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.186585 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.186591 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.187091 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:25.187433 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.188093 (+ 660us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.188439 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:32:25.189599 3232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:25.311342 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 3091
I20260811 01:32:25.334862 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 3246
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:32:25.353796 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.335790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32860 (local address 127.23.39.194:39611)
0811 01:32:25.335983 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.335990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.336013 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:32:25.336291 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.336297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.336386 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.336536 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:25.338037 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.338890 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.340279 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.340679 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.340829 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.345884 (+ 5055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:25.345906 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:25.345927 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:25.345989 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:25.350068 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.351113 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.351128 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.351133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.351378 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.351930 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.351936 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.351939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.352511 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:25.352850 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.353138 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.353424 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:32:25.354723 3394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:25.449016 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 3246
I20260811 01:32:25.472407 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 3405
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[2968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411942, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:32:25.492478 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:32:25.473351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42506 (local address 127.23.39.195:34991)
0811 01:32:25.473588 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 01:32:25.473595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:32:25.473620 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:32:25.473739 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:32:25.473748 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:32:25.473871 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:32:25.473998 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:32:25.475618 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.476880 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.478613 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:32:25.479314 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:32:25.479521 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:32:25.484502 (+ 4981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:32:25.484523 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:32:25.484544 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:32:25.484602 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:32:25.489247 (+ 4645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.490035 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.490047 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.490053 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.490296 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:32:25.490701 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:32:25.490706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:32:25.490710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:32:25.491203 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:32:25.491529 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0811 01:32:25.491796 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 01:32:25.492052 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:32:25.493296 3548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:25.622161 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 3405
I20260811 01:32:25.648528 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 2982
I20260811 01:32:25.649809 3057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:32:25.767717 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 2982
2026-08-11T01:32:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4945 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[3620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[3620](info): set up 2 sockets
Aug 11 01:32:25 dist-test-slave-9jjr krb5kdc[3620](info): commencing operation
krb5kdc: starting...
W20260811 01:32:26.972204 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:32:27 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:32:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:32:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangeradmin_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangeradmin_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangerlookup_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangerlookup_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
I20260811 01:32:27.442641 23711 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuc9edm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/postgres -l logfile start
2026-08-11 01:32:30.176 UTC [3653] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:32:30.177 UTC [3653] LOG: listening on IPv4 address "127.23.39.212", port 45451
2026-08-11 01:32:30.180 UTC [3653] LOG: listening on Unix socket "/tmp/.s.PGSQL.45451"
2026-08-11 01:32:30.207 UTC [3655] LOG: database system was shut down at 2026-08-11 01:32:28 UTC
2026-08-11 01:32:30.210 UTC [3653] LOG: database system is ready to accept connections
I20260811 01:32:31.268998 23711 mini_postgres.cc:96] Postgres bound to 45451
2026-08-11 01:32:31.296 UTC [3667] FATAL: database "slave" does not exist
127.23.39.212:45451 - accepting connections
I20260811 01:32:31.297108 23711 mini_ranger.cc:161] Starting Ranger...
I20260811 01:32:31.334233 23711 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:32:31.898335 23711 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:32:31.898484 23711 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin
2026-08-11 01:32:32,271 [I] DB FLAVOR :POSTGRES
2026-08-11 01:32:32,271 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:32:32,272 [I] Checking connection..
2026-08-11 01:32:32,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:32:32,565 [I] Checking connection passed.
2026-08-11 01:32:32,566 [I] --------- Verifying version history table ---------
2026-08-11 01:32:32,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:32:32,833 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:32:32,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:32:33,111 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:32:33,112 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:32:33,112 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:32:33.363 UTC [3743] WARNING: there is no transaction in progress
2026-08-11 01:32:33,370 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:32:33,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:32:33,629 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:32:33,630 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:32:33,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:32:33,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:32:34,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-9jjr.c.gcp-upstream.internal','N') ;"
2026-08-11 01:32:34,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:32:34,738 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:32:34,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:32:35,034 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:32:35,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:32:35,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:32:35,533 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:32:35,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:32:36.588 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.604 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.623 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.641 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.662 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.684 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.756 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.764 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.781 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.793 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.804 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.820 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.831 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.838 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.846 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:36.854 UTC [3867] WARNING: there is no transaction in progress
2026-08-11 01:32:37,584 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:32:37,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:32:37,833 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:32:37,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:32:38,097 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:32:38,098 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:32:38,345 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:32:38,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:32:38,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:32:38,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-9jjr.c.gcp-upstream.internal';"
2026-08-11 01:32:39,105 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:32:39,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:32:39,381 [I] DB_PATCHES have already been applied
I20260811 01:32:39.387682 23711 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuc9edm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:32:39.387815 23711 mini_ranger.cc:193] Using host: 127.23.39.212
I20260811 01:32:39.411934 23711 mini_ranger.cc:227] Ranger admin URL: http://127.23.39.212:56165
Aug 11, 2026 1:32:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:32:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:32:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:32:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:32:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:32:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:32:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:32:40.657840 23711 mini_ranger.cc:160] Time spent starting Ranger: real 9.361s user 0.005s sys 0.076s
Aug 11, 2026 1:33:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:33:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 1:33:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:33:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:33:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:33:04.216094 23711 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangerkms_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/rangerkms_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.39.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.39.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:33:04 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411984, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:33:04.457176 23711 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:33:04.488686 23711 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:33:05.511628 23711 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:33:05.511842 23711 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms
I20260811 01:33:05.511987 23711 mini_ranger_kms.cc:227] Using postgres at 127.23.39.212:45451
2026-08-11 01:33:06,175 [I] DB FLAVOR :POSTGRES
2026-08-11 01:33:06,176 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:33:06,176 [I] Checking connection
2026-08-11 01:33:06,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:33:06,455 [I] connection success
2026-08-11 01:33:06,456 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:33:06,456 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:33:06,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:33:06,711 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:33:06,712 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:33:06,712 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:33:06,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:45451/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:33:06,995 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:33:07.504232 23711 mini_ranger_kms.cc:310] Created kms service
I20260811 01:33:07.721331 23711 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:33:07.768697 23711 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:33:07 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411984, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:08.186506 23711 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:33:08.188052 23711 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:33:08.188128 23711 mini_ranger_kms.cc:240] Using host: 127.23.39.212
I20260811 01:33:08.217247 23711 mini_ranger_kms.cc:276] Ranger KMS PID: 4079
I20260811 01:33:08.217453 23711 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.39.212:35525
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:33:09 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 01:33:10 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786411990, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:33:10.717866 23711 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.261s user 0.130s sys 0.520s
I20260811 01:33:10.718286 23711 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:33:10.718545 23711 mini_ranger_kms.cc:401] 127.23.39.212:35525/kms/v1/keys
Aug 11 01:33:11 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411990, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
Aug 11 01:33:11 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411990, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
Aug 11 01:33:13 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:33:13.810545 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34831
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:34831
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:35525/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:33:14.191155 4136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:33:14.191489 4136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:33:14.191583 4136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:33:14.199373 4136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:33:14.199515 4136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:33:14.199561 4136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:33:14.199612 4136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:33:14.199663 4136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:33:14.210593 4136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.39.212:35525/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:34831
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:33:14.212177 4136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:33:14.213557 4136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:33:14.227360 4141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:14.227309 4145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:14.227401 4143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:33:14.228520 4136 server_base.cc:1034] running on GCE node
I20260811 01:33:14.229477 4136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:33:14.231161 4136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:33:14.232411 4136 hybrid_clock.cc:648] HybridClock initialized: now 1786411994232358 us; error 45 us; skew 500 ppm
I20260811 01:33:14.232847 4136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:33:14 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:33:14.236493 4136 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:33:14.238287 4136 webserver.cc:460] Webserver started at http://127.23.39.254:33795/ using document root <none> and password file <none>
I20260811 01:33:14.238963 4136 fs_manager.cc:359] Metadata directory not provided
I20260811 01:33:14.239102 4136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:33:14.239425 4136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:33:14 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411994, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:14.305364 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b81ae0c51bea45569e53420742ed2aab"
format_stamp: "Formatted at 2026-08-11 01:33:14 on dist-test-slave-9jjr"
server_key: "fc99458af7f4e3d97d3d6b1c0288242c"
server_key_iv: "b1a4787dc37db2ef2c46640d1bcb4c60"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:14.306550 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b81ae0c51bea45569e53420742ed2aab"
format_stamp: "Formatted at 2026-08-11 01:33:14 on dist-test-slave-9jjr"
server_key: "fc99458af7f4e3d97d3d6b1c0288242c"
server_key_iv: "b1a4787dc37db2ef2c46640d1bcb4c60"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:14.313045 4136 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 01:33:14.334216 4153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:14.335948 4136 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:33:14.336174 4136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b81ae0c51bea45569e53420742ed2aab"
format_stamp: "Formatted at 2026-08-11 01:33:14 on dist-test-slave-9jjr"
server_key: "fc99458af7f4e3d97d3d6b1c0288242c"
server_key_iv: "b1a4787dc37db2ef2c46640d1bcb4c60"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:14.336442 4136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:33:14.351411 4136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:33:14.355933 4136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:33:14.356279 4136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:33:14.378476 4136 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:34831
I20260811 01:33:14.378485 4211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:34831 every 8 connection(s)
I20260811 01:33:14.379997 4136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:33:14.381444 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 4136
I20260811 01:33:14.381667 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:33:14.382592 23711 external_mini_cluster.cc:1428] Setting key d6b36fa0dddec9f35717413628a20e06
I20260811 01:33:14.385507 4212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:33:14 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:33:14.397490 4212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: Bootstrap starting.
I20260811 01:33:14.402029 4212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: Neither blocks nor log segments found. Creating new log.
I20260811 01:33:14.403462 4212 log.cc:824] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: Log is configured to *not* fsync() on all Append() calls
I20260811 01:33:14.407227 4212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: No bootstrap required, opened a new log
I20260811 01:33:14.407364 4216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:14.385081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39848 (local address 127.23.39.254:34831)
0811 01:33:14.386022 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:14.386034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:14.386082 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:33:14.387816 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:14.387840 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:14.388271 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:14.388696 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:14.390190 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:14.391684 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:14.392977 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:14.393701 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:14.393896 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:14.398385 (+ 4489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:14.398396 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:14.398416 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:14.398472 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:14.402644 (+ 4172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:14.403468 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:14.403479 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:14.403489 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:14.403696 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:14.404242 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:14.404247 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:14.404250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:14.404821 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:14.405143 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:14.405544 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 01:33:14.405949 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":439,"threads_started":1}
I20260811 01:33:14.416100 4212 raft_consensus.cc:348] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } }
I20260811 01:33:14.416486 4212 raft_consensus.cc:374] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:33:14.416569 4212 raft_consensus.cc:729] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81ae0c51bea45569e53420742ed2aab, State: Initialized, Role: FOLLOWER
I20260811 01:33:14.417142 4212 consensus_queue.cc:260] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } }
I20260811 01:33:14.417367 4212 raft_consensus.cc:388] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:33:14.417474 4212 raft_consensus.cc:482] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:33:14.417618 4212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:33:14.420011 4212 raft_consensus.cc:504] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } }
I20260811 01:33:14.420760 4212 leader_election.cc:302] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b81ae0c51bea45569e53420742ed2aab; no voters:
I20260811 01:33:14.421396 4212 leader_election.cc:288] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:33:14.421564 4218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:33:14.422335 4218 raft_consensus.cc:686] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [term 1 LEADER]: Becoming Leader. State: Replica: b81ae0c51bea45569e53420742ed2aab, State: Running, Role: LEADER
I20260811 01:33:14.422945 4218 consensus_queue.cc:237] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } }
I20260811 01:33:14.423725 4212 sys_catalog.cc:564] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:33:14.425725 4219 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b81ae0c51bea45569e53420742ed2aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } } }
I20260811 01:33:14.426229 4219 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [sys.catalog]: This master's current role is: LEADER
I20260811 01:33:14.427501 4220 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [sys.catalog]: SysCatalogTable state changed. Reason: New leader b81ae0c51bea45569e53420742ed2aab. Latest consensus state: current_term: 1 leader_uuid: "b81ae0c51bea45569e53420742ed2aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81ae0c51bea45569e53420742ed2aab" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34831 } } }
I20260811 01:33:14.428098 4220 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab [sys.catalog]: This master's current role is: LEADER
I20260811 01:33:14.430080 4226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:33:14.437681 4226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:33:14.438585 4212 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:33:14.460644 4226 catalog_manager.cc:1347] Generated new cluster ID: 1fbaee240df348fd8db81ce9870a3b54
I20260811 01:33:14.460873 4226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:33:14.496671 4226 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:33:14.498281 4226 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:33:14.520025 4226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: Generated new TSK 0
I20260811 01:33:14.521359 4226 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:33:15.346572 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:35525/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:33:15 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 01:33:15.844741 4267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:33:15.845063 4267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:33:15.845254 4267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:33:15.853184 4267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:33:15.853322 4267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:33:15.853500 4267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:33:15.864332 4267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.39.212:35525/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:33:15.865839 4267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:33:15.867429 4267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:33:15.896397 4278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:15.897854 4279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:15.903522 4283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:33:15.904137 4267 server_base.cc:1034] running on GCE node
I20260811 01:33:15.905071 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:33:15.907559 4267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:33:15.908924 4267 hybrid_clock.cc:648] HybridClock initialized: now 1786411995908814 us; error 107 us; skew 500 ppm
I20260811 01:33:15.909420 4267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:33:15 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:33:15.918005 4267 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:33:15.920661 4267 webserver.cc:460] Webserver started at http://127.23.39.193:44581/ using document root <none> and password file <none>
I20260811 01:33:15.921679 4267 fs_manager.cc:359] Metadata directory not provided
I20260811 01:33:15.921835 4267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:33:15.922259 4267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:33:15 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:15.958050 4267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "a5f8dc8f6f044f2c9477a9086bef0730"
format_stamp: "Formatted at 2026-08-11 01:33:15 on dist-test-slave-9jjr"
server_key: "4ccb5846c758d8c5b268a582471fe348"
server_key_iv: "63f85d9ef9ef5e8e0910bbc14db6866b"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:15.959357 4267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "a5f8dc8f6f044f2c9477a9086bef0730"
format_stamp: "Formatted at 2026-08-11 01:33:15 on dist-test-slave-9jjr"
server_key: "4ccb5846c758d8c5b268a582471fe348"
server_key_iv: "63f85d9ef9ef5e8e0910bbc14db6866b"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:15.975234 4267 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.012s sys 0.002s
I20260811 01:33:16.003196 4289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:16.005530 4267 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.007s
I20260811 01:33:16.005882 4267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "a5f8dc8f6f044f2c9477a9086bef0730"
format_stamp: "Formatted at 2026-08-11 01:33:15 on dist-test-slave-9jjr"
server_key: "4ccb5846c758d8c5b268a582471fe348"
server_key_iv: "63f85d9ef9ef5e8e0910bbc14db6866b"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:16.006263 4267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:33:16.066690 4267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:33:16.072710 4267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:33:16.073174 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 11 01:33:16 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:16.085807 4267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:33:16.094336 4267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:33:16.094533 4267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:16.094857 4267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:33:16.095003 4267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:16.276021 4267 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:40877
I20260811 01:33:16.276075 4413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:40877 every 8 connection(s)
I20260811 01:33:16.278026 4267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:33:16.282687 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 4267
I20260811 01:33:16.282948 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:33:16.284016 23711 external_mini_cluster.cc:1428] Setting key 66e1726ced72f2ef98428fa86d35c962
Aug 11 01:33:16 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:33:16.321687 4419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:16.282371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:41515 (local address 127.23.39.254:34831)
0811 01:33:16.294569 (+ 12198us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:16.294589 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:16.300238 (+ 5649us) server_negotiation.cc:407] Connection header received
0811 01:33:16.300342 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:16.300349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:16.300480 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:16.300627 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:16.303679 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:16.304880 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:16.307857 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:16.308609 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:16.308741 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:16.314060 (+ 5319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:16.314066 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:16.314071 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:16.314114 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:16.317586 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:16.318702 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:16.318708 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:16.318711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:16.318876 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:16.319527 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:16.319532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:16.319536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:16.319911 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:16.320040 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:16.321062 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 01:33:16.321307 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11992,"thread_start_us":11816,"threads_started":1}
I20260811 01:33:16.324259 4418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:16.281855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34831 (local address 127.23.39.193:41515)
0811 01:33:16.295489 (+ 13634us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:16.295596 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:16.299551 (+ 3955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:16.301860 (+ 2309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:16.301870 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:16.302647 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:33:16.303401 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:16.303423 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:16.305148 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:16.305154 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:16.307613 (+ 2459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:16.307655 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:16.309175 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:16.309185 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:16.309520 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:16.310476 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:33:16.310509 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:33:16.313761 (+ 3252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:33:16.317782 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:16.317792 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:16.317811 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:16.318544 (+ 733us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:16.319031 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:16.319035 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:16.319039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:16.319382 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:16.320149 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:33:16.320157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:33:16.320621 (+ 464us) client_negotiation.cc:769] Sending connection context
0811 01:33:16.322202 (+ 1581us) client_negotiation.cc:240] Negotiation successful
0811 01:33:16.322766 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13145,"thread_start_us":20582,"threads_started":1}
I20260811 01:33:16.326413 4415 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34831
I20260811 01:33:16.326800 4415 heartbeater.cc:464] Registering TS with master...
I20260811 01:33:16.327742 4415 heartbeater.cc:511] Master 127.23.39.254:34831 requested a full tablet report, sending...
I20260811 01:33:16.330662 4173 ts_manager.cc:194] Registered new tserver with Master: a5f8dc8f6f044f2c9477a9086bef0730 (127.23.39.193:40877)
I20260811 01:33:16.332832 4173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:41515
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:33:16.385265 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:35525/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:33:16 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411995, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
W20260811 01:33:16.867609 4422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:33:16.867985 4422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:33:16.868148 4422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:33:16.875805 4422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:33:16.875983 4422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:33:16.876179 4422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:33:16.886620 4422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.39.212:35525/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:33:16.888010 4422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:33:16.889361 4422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:33:16.904556 4438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:16.904686 4440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:16.904548 4437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:33:16.905808 4422 server_base.cc:1034] running on GCE node
I20260811 01:33:16.906612 4422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:33:16.907656 4422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:33:16.908957 4422 hybrid_clock.cc:648] HybridClock initialized: now 1786411996908890 us; error 48 us; skew 500 ppm
I20260811 01:33:16.909338 4422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:33:16 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411996, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:33:16.912958 4422 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:33:16.914620 4422 webserver.cc:460] Webserver started at http://127.23.39.194:43983/ using document root <none> and password file <none>
I20260811 01:33:16.915331 4422 fs_manager.cc:359] Metadata directory not provided
I20260811 01:33:16.915479 4422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:33:16.915831 4422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:33:16 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411996, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:16.930853 4422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "0b26e52e11304be7891c8883aaaed44c"
format_stamp: "Formatted at 2026-08-11 01:33:16 on dist-test-slave-9jjr"
server_key: "f8959acdab11f00a1fa7ec4ed132f01c"
server_key_iv: "67e51b24f598485ba0a7125f6c2b100a"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:16.931823 4422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "0b26e52e11304be7891c8883aaaed44c"
format_stamp: "Formatted at 2026-08-11 01:33:16 on dist-test-slave-9jjr"
server_key: "f8959acdab11f00a1fa7ec4ed132f01c"
server_key_iv: "67e51b24f598485ba0a7125f6c2b100a"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:16.937629 4422 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:33:16.955276 4447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:16.957216 4422 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:33:16.957427 4422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "0b26e52e11304be7891c8883aaaed44c"
format_stamp: "Formatted at 2026-08-11 01:33:16 on dist-test-slave-9jjr"
server_key: "f8959acdab11f00a1fa7ec4ed132f01c"
server_key_iv: "67e51b24f598485ba0a7125f6c2b100a"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:16.957703 4422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:33:16.980818 4422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:33:16.985464 4422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:33:16.985811 4422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:33:16.987017 4422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:33:16.988559 4422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:33:16.988637 4422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:16.988788 4422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:33:16.988839 4422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:17.037715 4422 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:45501
I20260811 01:33:17.037761 4579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:45501 every 8 connection(s)
I20260811 01:33:17.039201 4422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:33:17.041963 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 4422
I20260811 01:33:17.042178 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:33:17.042762 23711 external_mini_cluster.cc:1428] Setting key d2bfb0e7813bda20358dc664fb18da36
Aug 11 01:33:17 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411996, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:33:17.074855 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.042392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:44555 (local address 127.23.39.254:34831)
0811 01:33:17.057680 (+ 15288us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.057687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.057719 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:33:17.058741 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.058750 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.058852 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.058982 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:17.061205 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.062370 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.064381 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.064797 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.064946 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.068699 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:17.068704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:17.068707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:17.068741 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:17.071615 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.072401 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.072406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.072408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.072529 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.072970 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.072977 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.072980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.073284 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:17.073463 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.074223 (+ 760us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.074468 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15122,"thread_start_us":15321,"threads_started":1}
I20260811 01:33:17.076014 4583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.043163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34831 (local address 127.23.39.194:44555)
0811 01:33:17.055038 (+ 11875us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.055136 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.058332 (+ 3196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.059301 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.059315 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.060006 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:33:17.060961 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.060989 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.062548 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.062552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.064194 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.064210 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.065060 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.065069 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.065342 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.066079 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:33:17.066104 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:33:17.068463 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:33:17.071771 (+ 3308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:17.071780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:17.071799 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:17.072262 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:17.072643 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:17.072648 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:17.072652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:17.072859 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:17.073426 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:33:17.073436 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:33:17.073806 (+ 370us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.074088 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.074675 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11400,"thread_start_us":11095,"threads_started":1}
I20260811 01:33:17.077699 4580 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34831
I20260811 01:33:17.078022 4580 heartbeater.cc:464] Registering TS with master...
I20260811 01:33:17.078796 4580 heartbeater.cc:511] Master 127.23.39.254:34831 requested a full tablet report, sending...
I20260811 01:33:17.080319 4173 ts_manager.cc:194] Registered new tserver with Master: 0b26e52e11304be7891c8883aaaed44c (127.23.39.194:45501)
I20260811 01:33:17.081158 4173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:44555
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:33:17.126498 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:35525/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:33:17.337013 4415 heartbeater.cc:503] Master 127.23.39.254:34831 was elected leader, sending a full tablet report...
W20260811 01:33:17.518419 4586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:33:17.518713 4586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:33:17.518864 4586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:33:17.526684 4586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:33:17.526801 4586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:33:17.526968 4586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:33:17.537307 4586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.39.212:35525/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:33:17.538733 4586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:33:17.540198 4586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:33:17.554774 4592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:17.554803 4591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:33:17.554725 4594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:33:17.555330 4586 server_base.cc:1034] running on GCE node
I20260811 01:33:17.556145 4586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:33:17.557137 4586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:33:17.558367 4586 hybrid_clock.cc:648] HybridClock initialized: now 1786411997558310 us; error 49 us; skew 500 ppm
I20260811 01:33:17.558686 4586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:33:17 dist-test-slave-9jjr krb5kdc[3620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411997, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:33:17.561944 4586 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:33:17.563704 4586 webserver.cc:460] Webserver started at http://127.23.39.195:43533/ using document root <none> and password file <none>
I20260811 01:33:17.564414 4586 fs_manager.cc:359] Metadata directory not provided
I20260811 01:33:17.564548 4586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:33:17.564874 4586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:33:17 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411997, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:33:17.579010 4586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "de559e9653044d03b426db02c7db0cc5"
format_stamp: "Formatted at 2026-08-11 01:33:17 on dist-test-slave-9jjr"
server_key: "f94dc4e9d22e46de5385a3a9c9227f07"
server_key_iv: "f046a0deb672cc0567c5adc99d244853"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:17.579950 4586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "de559e9653044d03b426db02c7db0cc5"
format_stamp: "Formatted at 2026-08-11 01:33:17 on dist-test-slave-9jjr"
server_key: "f94dc4e9d22e46de5385a3a9c9227f07"
server_key_iv: "f046a0deb672cc0567c5adc99d244853"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:17.585879 4586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:33:17.601006 4601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:17.602669 4586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:33:17.602860 4586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "de559e9653044d03b426db02c7db0cc5"
format_stamp: "Formatted at 2026-08-11 01:33:17 on dist-test-slave-9jjr"
server_key: "f94dc4e9d22e46de5385a3a9c9227f07"
server_key_iv: "f046a0deb672cc0567c5adc99d244853"
server_key_version: "kuduclusterkey@0"
I20260811 01:33:17.603119 4586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:33:17.618955 4586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:33:17.622706 4586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:33:17.623086 4586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:33:17.624155 4586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:33:17.625685 4586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:33:17.625794 4586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:17.625946 4586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:33:17.626001 4586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:33:17.663112 4586 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:41995
I20260811 01:33:17.663159 4735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:41995 every 8 connection(s)
I20260811 01:33:17.664466 4586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:33:17.674862 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 4586
I20260811 01:33:17.675043 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:33:17.675587 23711 external_mini_cluster.cc:1428] Setting key d367eec3f8046cf479af8983e308552d
Aug 11 01:33:17 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411997, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:33:17.684229 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.667191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:60697 (local address 127.23.39.254:34831)
0811 01:33:17.667738 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.667746 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.668735 (+ 989us) server_negotiation.cc:407] Connection header received
0811 01:33:17.670629 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.670633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.670701 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.670809 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:17.672279 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.673004 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.674702 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.675222 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.675344 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.679016 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:17.679021 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:17.679024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:17.679058 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:17.681468 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.682271 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.682276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.682278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.682403 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.682763 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.682766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.682768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.683025 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:17.683153 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.683752 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.683930 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":231,"threads_started":1}
I20260811 01:33:17.685181 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.667806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34831 (local address 127.23.39.195:60697)
0811 01:33:17.668560 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.668608 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.670347 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.670999 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.671007 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.671506 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:33:17.672101 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.672118 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.673140 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.673144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.674530 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.674574 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.675462 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.675470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.675773 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.676526 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:33:17.676560 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:33:17.678819 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:33:17.681590 (+ 2771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:17.681596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:17.681609 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:17.682118 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:17.682492 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:33:17.682496 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:33:17.682498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:33:17.682670 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:33:17.683139 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:33:17.683144 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:33:17.683439 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.683660 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.684084 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":322,"threads_started":1}
I20260811 01:33:17.686558 4736 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34831
I20260811 01:33:17.686874 4736 heartbeater.cc:464] Registering TS with master...
I20260811 01:33:17.687668 4736 heartbeater.cc:511] Master 127.23.39.254:34831 requested a full tablet report, sending...
I20260811 01:33:17.689061 4173 ts_manager.cc:194] Registered new tserver with Master: de559e9653044d03b426db02c7db0cc5 (127.23.39.195:41995)
I20260811 01:33:17.690217 4173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:60697
I20260811 01:33:17.691144 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:33:17.709720 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.696034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.23.39.254:34831)
0811 01:33:17.696195 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.696201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.696740 (+ 539us) server_negotiation.cc:407] Connection header received
0811 01:33:17.696910 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.696913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.696985 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.697062 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:17.698697 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.699411 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.700773 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.701182 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.701278 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.703972 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:17.703977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:17.703981 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:17.704015 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:17.707093 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.707883 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.707889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.707892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.708035 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:17.708473 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:17.708477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:17.708479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:17.708777 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:17.708972 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.709297 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.709489 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:33:17.714515 4172 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:33:17.721907 4172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:33:17.760272 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.736752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47960 (local address 127.23.39.194:45501)
0811 01:33:17.750978 (+ 14226us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.750984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.751010 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:33:17.751104 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.751110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.751351 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.751885 (+ 534us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.753095 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.754624 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.756951 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.758996 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.759158 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.759370 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.759700 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.759899 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14083,"thread_start_us":13976,"threads_started":1}
I20260811 01:33:17.760262 4755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.736457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:45501 (local address 127.0.0.1:47960)
0811 01:33:17.749630 (+ 13173us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.749659 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.749829 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.752264 (+ 2435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.752271 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.752301 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.752899 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.752911 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.754750 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.754756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.756754 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.756766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.759214 (+ 2448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.759220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.759427 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.759479 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.759615 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.759837 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12981,"mutex_wait_us":3,"thread_start_us":16863,"threads_started":1}
I20260811 01:33:17.761310 4751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.735942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:41995 (local address 127.0.0.1:59410)
0811 01:33:17.736890 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.736953 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.737167 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.752442 (+ 15275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.752451 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.752496 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.753251 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.753268 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.755580 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.755586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.758065 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.758080 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.760391 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.760400 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.760582 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.760619 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.760725 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.760862 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":25,"thread_start_us":1056,"threads_started":1}
I20260811 01:33:17.761329 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.736039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59410 (local address 127.23.39.195:41995)
0811 01:33:17.751641 (+ 15602us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.751652 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.751698 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:33:17.751821 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.751836 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.752127 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.753488 (+ 1361us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.753801 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.755434 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.758315 (+ 2881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.759801 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.759943 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.760206 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.760773 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.760933 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15376,"thread_start_us":15206,"threads_started":1}
I20260811 01:33:17.764258 4499 tablet_service.cc:1467] Processing CreateTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 (DEFAULT_TABLE table=test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:33:17.764719 4659 tablet_service.cc:1467] Processing CreateTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 (DEFAULT_TABLE table=test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:33:17.765453 4753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.737971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40877 (local address 127.0.0.1:47516)
0811 01:33:17.753617 (+ 15646us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.753636 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.753762 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.754434 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.754443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.754469 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.754962 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.754976 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.756856 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.756864 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.758647 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.758664 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.761253 (+ 2589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.761262 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.761457 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.761494 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.761636 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.765084 (+ 3448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15513,"thread_start_us":11251,"threads_started":1}
I20260811 01:33:17.765766 4499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc18a4666f5d4f8cae71f8aca36b3a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:33:17.766316 4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.738403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.23.39.193:40877)
0811 01:33:17.748430 (+ 10027us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.748443 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.753779 (+ 5336us) server_negotiation.cc:407] Connection header received
0811 01:33:17.753933 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.753943 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.754212 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.754407 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.755168 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.756709 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.758845 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.760344 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.760808 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.761053 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.765713 (+ 4660us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.765938 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9777,"thread_start_us":10316,"threads_started":1}
I20260811 01:33:17.766348 4659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc18a4666f5d4f8cae71f8aca36b3a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:33:17.769949 4342 tablet_service.cc:1467] Processing CreateTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 (DEFAULT_TABLE table=test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:33:17.771493 4342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc18a4666f5d4f8cae71f8aca36b3a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:33:17.778776 4757 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Bootstrap starting.
I20260811 01:33:17.780593 4758 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Bootstrap starting.
I20260811 01:33:17.783557 4757 tablet_bootstrap.cc:654] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Neither blocks nor log segments found. Creating new log.
I20260811 01:33:17.784587 4758 tablet_bootstrap.cc:654] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Neither blocks nor log segments found. Creating new log.
I20260811 01:33:17.785437 4759 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Bootstrap starting.
I20260811 01:33:17.786095 4757 log.cc:824] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:33:17.786288 4758 log.cc:824] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:33:17.789052 4759 tablet_bootstrap.cc:654] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Neither blocks nor log segments found. Creating new log.
I20260811 01:33:17.789551 4757 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: No bootstrap required, opened a new log
I20260811 01:33:17.789553 4758 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: No bootstrap required, opened a new log
I20260811 01:33:17.789849 4757 ts_tablet_manager.cc:1397] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s
I20260811 01:33:17.789849 4758 ts_tablet_manager.cc:1397] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 01:33:17.790282 4759 log.cc:824] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Log is configured to *not* fsync() on all Append() calls
I20260811 01:33:17.793145 4759 tablet_bootstrap.cc:492] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: No bootstrap required, opened a new log
I20260811 01:33:17.793445 4759 ts_tablet_manager.cc:1397] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 01:33:17.801290 4759 raft_consensus.cc:348] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.801317 4757 raft_consensus.cc:348] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.801683 4759 raft_consensus.cc:374] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:33:17.801769 4759 raft_consensus.cc:729] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5f8dc8f6f044f2c9477a9086bef0730, State: Initialized, Role: FOLLOWER
I20260811 01:33:17.801795 4757 raft_consensus.cc:374] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:33:17.801887 4757 raft_consensus.cc:729] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de559e9653044d03b426db02c7db0cc5, State: Initialized, Role: FOLLOWER
I20260811 01:33:17.801668 4758 raft_consensus.cc:348] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.802151 4758 raft_consensus.cc:374] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:33:17.802419 4758 raft_consensus.cc:729] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b26e52e11304be7891c8883aaaed44c, State: Initialized, Role: FOLLOWER
I20260811 01:33:17.802572 4757 consensus_queue.cc:260] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.802528 4759 consensus_queue.cc:260] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.802999 4758 consensus_queue.cc:260] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.804467 4580 heartbeater.cc:503] Master 127.23.39.254:34831 was elected leader, sending a full tablet report...
I20260811 01:33:17.805393 4758 ts_tablet_manager.cc:1428] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Time spent starting tablet: real 0.015s user 0.004s sys 0.011s
I20260811 01:33:17.807153 4759 ts_tablet_manager.cc:1428] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260811 01:33:17.810000 4736 heartbeater.cc:503] Master 127.23.39.254:34831 was elected leader, sending a full tablet report...
I20260811 01:33:17.810655 4757 ts_tablet_manager.cc:1428] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Time spent starting tablet: real 0.021s user 0.013s sys 0.010s
W20260811 01:33:17.916256 4737 tablet.cc:2369] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:33:17.918571 4767 raft_consensus.cc:482] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:33:17.918874 4767 raft_consensus.cc:504] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.920605 4769 raft_consensus.cc:482] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:33:17.920642 4767 leader_election.cc:288] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b26e52e11304be7891c8883aaaed44c (127.23.39.194:45501), a5f8dc8f6f044f2c9477a9086bef0730 (127.23.39.193:40877)
I20260811 01:33:17.920981 4769 raft_consensus.cc:504] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.923575 4769 leader_election.cc:288] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de559e9653044d03b426db02c7db0cc5 (127.23.39.195:41995), a5f8dc8f6f044f2c9477a9086bef0730 (127.23.39.193:40877)
I20260811 01:33:17.928679 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.920860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:45501 (local address 127.23.39.195:57159)
0811 01:33:17.921144 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.921167 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.921306 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.921873 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.921879 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.921906 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.922168 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.922182 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.923665 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.923671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.926005 (+ 2334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.926016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.927837 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.927845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.928056 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.928097 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.928197 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.928347 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":1}
I20260811 01:33:17.929333 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.921117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:57159 (local address 127.23.39.194:45501)
0811 01:33:17.921365 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.921373 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.921395 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:33:17.921483 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.921491 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.921580 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.921682 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.922368 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.923485 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.926223 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.927533 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.927658 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.927746 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.928975 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.929107 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:33:17.929718 4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.921767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:39159 (local address 127.23.39.193:40877)
0811 01:33:17.922048 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.922055 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.922115 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:33:17.922340 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.922345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.922428 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.922541 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.923214 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.924331 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.927061 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.928545 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.928695 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.928764 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.929298 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.929440 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":126}
I20260811 01:33:17.930491 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.921139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40877 (local address 127.23.39.195:39159)
0811 01:33:17.922013 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.922041 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.922198 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.922567 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.922571 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.922596 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.923031 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.923044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.924534 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.924539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.926855 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.926871 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.928944 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.928952 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.929125 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.929156 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.929966 (+ 810us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.930113 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":471,"threads_started":1}
I20260811 01:33:17.930392 4524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "de559e9653044d03b426db02c7db0cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b26e52e11304be7891c8883aaaed44c" is_pre_election: true
I20260811 01:33:17.930961 4524 raft_consensus.cc:2454] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de559e9653044d03b426db02c7db0cc5 in term 0.
I20260811 01:33:17.931610 4364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "de559e9653044d03b426db02c7db0cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" is_pre_election: true
I20260811 01:33:17.931833 4604 leader_election.cc:302] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b26e52e11304be7891c8883aaaed44c, de559e9653044d03b426db02c7db0cc5; no voters:
I20260811 01:33:17.932188 4364 raft_consensus.cc:2454] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de559e9653044d03b426db02c7db0cc5 in term 0.
I20260811 01:33:17.932269 4767 raft_consensus.cc:2781] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:33:17.932438 4767 raft_consensus.cc:482] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:33:17.932561 4767 raft_consensus.cc:3037] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:33:17.935380 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.924818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40877 (local address 127.23.39.194:45643)
0811 01:33:17.925567 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.925588 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.925699 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.926639 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.926644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.926669 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.927210 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.927224 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.929682 (+ 2458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.929692 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.932536 (+ 2844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.932552 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.934406 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.934413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.934617 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.934659 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.934738 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.934892 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"mutex_wait_us":2,"thread_start_us":465,"threads_started":1}
I20260811 01:33:17.935575 4767 raft_consensus.cc:504] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.935971 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.924066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56973 (local address 127.23.39.195:41995)
0811 01:33:17.925878 (+ 1812us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.925883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.925900 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:33:17.925959 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.925963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.926034 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.926142 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.928333 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.929419 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.933163 (+ 3744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.934741 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.934884 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.934950 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.935613 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.935752 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1674}
I20260811 01:33:17.936040 4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.923903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:41995 (local address 127.23.39.194:56973)
0811 01:33:17.924740 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0811 01:33:17.924761 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:33:17.924974 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:33:17.927789 (+ 2815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:33:17.927793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:33:17.927819 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:33:17.928169 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.928183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.929585 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.929595 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.933011 (+ 3416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:33:17.933027 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.935103 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.935110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:33:17.935275 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.935321 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 01:33:17.935428 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 01:33:17.935564 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":143,"thread_start_us":432,"threads_started":1}
I20260811 01:33:17.936017 4773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.925568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:45643 (local address 127.23.39.193:40877)
0811 01:33:17.926326 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.926331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.926355 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:33:17.926410 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.926415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.926485 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.927389 (+ 904us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:33:17.927704 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.929530 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.932733 (+ 3203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.934108 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.934911 (+ 803us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.934982 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.935030 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.935158 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":617,"thread_start_us":2799,"threads_started":1}
I20260811 01:33:17.936395 4767 leader_election.cc:288] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [CANDIDATE]: Term 1 election: Requested vote from peers 0b26e52e11304be7891c8883aaaed44c (127.23.39.194:45501), a5f8dc8f6f044f2c9477a9086bef0730 (127.23.39.193:40877)
I20260811 01:33:17.937045 4364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "de559e9653044d03b426db02c7db0cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f8dc8f6f044f2c9477a9086bef0730"
I20260811 01:33:17.937239 4364 raft_consensus.cc:3037] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:33:17.937089 4685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "0b26e52e11304be7891c8883aaaed44c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de559e9653044d03b426db02c7db0cc5" is_pre_election: true
I20260811 01:33:17.937266 4362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "0b26e52e11304be7891c8883aaaed44c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" is_pre_election: true
I20260811 01:33:17.937620 4685 raft_consensus.cc:2379] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b26e52e11304be7891c8883aaaed44c in current term 1: Already voted for candidate de559e9653044d03b426db02c7db0cc5 in this term.
I20260811 01:33:17.938321 4524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc18a4666f5d4f8cae71f8aca36b3a09" candidate_uuid: "de559e9653044d03b426db02c7db0cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b26e52e11304be7891c8883aaaed44c"
I20260811 01:33:17.938544 4524 raft_consensus.cc:3037] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:33:17.938736 4448 leader_election.cc:302] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b26e52e11304be7891c8883aaaed44c; no voters: a5f8dc8f6f044f2c9477a9086bef0730, de559e9653044d03b426db02c7db0cc5
I20260811 01:33:17.940286 4364 raft_consensus.cc:2454] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de559e9653044d03b426db02c7db0cc5 in term 1.
I20260811 01:33:17.940737 4602 leader_election.cc:302] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5f8dc8f6f044f2c9477a9086bef0730, de559e9653044d03b426db02c7db0cc5; no voters:
I20260811 01:33:17.941044 4767 raft_consensus.cc:2781] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:33:17.941551 4767 raft_consensus.cc:686] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 LEADER]: Becoming Leader. State: Replica: de559e9653044d03b426db02c7db0cc5, State: Running, Role: LEADER
I20260811 01:33:17.941680 4524 raft_consensus.cc:2454] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de559e9653044d03b426db02c7db0cc5 in term 1.
I20260811 01:33:17.941845 4769 raft_consensus.cc:2726] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 01:33:17.942996 4767 consensus_queue.cc:237] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } }
I20260811 01:33:17.947691 4170 catalog_manager.cc:5495] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to de559e9653044d03b426db02c7db0cc5 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "de559e9653044d03b426db02c7db0cc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de559e9653044d03b426db02c7db0cc5" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 } health_report { overall_health: UNKNOWN } } }
I20260811 01:33:17.986617 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:17.980890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59416 (local address 127.23.39.195:41995)
0811 01:33:17.981117 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:17.981122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:17.981142 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:33:17.981354 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:17.981358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:17.981436 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:17.981562 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:33:17.981882 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.982840 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.984360 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:17.984776 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:17.984905 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:17.985429 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:33:17.985942 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:33:17.986053 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:17.986121 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 01:33:17.986273 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:33:17.995205 4364 raft_consensus.cc:1261] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 1 FOLLOWER]: Refusing update from remote peer de559e9653044d03b426db02c7db0cc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:33:17.995261 4524 raft_consensus.cc:1261] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 1 FOLLOWER]: Refusing update from remote peer de559e9653044d03b426db02c7db0cc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:33:17.996122 4774 consensus_queue.cc:1035] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5f8dc8f6f044f2c9477a9086bef0730" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:33:17.996519 4767 consensus_queue.cc:1035] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b26e52e11304be7891c8883aaaed44c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 45501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:33:18.006230 4777 mvcc.cc:205] Tried to move back new op lower bound from 7317143543777501184 to 7317143543578185728. Current Snapshot: MvccSnapshot[applied={T|T < 7317143543777501184}]
I20260811 01:33:18.009706 4779 mvcc.cc:205] Tried to move back new op lower bound from 7317143543777501184 to 7317143543578185728. Current Snapshot: MvccSnapshot[applied={T|T < 7317143543777501184}]
I20260811 01:33:18.023561 4172 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:33:18.023867 4172 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:33:18.027892 4172 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b81ae0c51bea45569e53420742ed2aab: Sending DeleteTablet for 3 replicas of tablet fc18a4666f5d4f8cae71f8aca36b3a09
I20260811 01:33:18.029322 4499 tablet_service.cc:1514] Processing DeleteTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:33:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:47960
I20260811 01:33:18.029340 4342 tablet_service.cc:1514] Processing DeleteTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:33:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:47516
I20260811 01:33:18.030256 4659 tablet_service.cc:1514] Processing DeleteTablet for tablet fc18a4666f5d4f8cae71f8aca36b3a09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:33:18 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:59410
I20260811 01:33:18.033434 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 4267
I20260811 01:33:18.041636 4791 tablet_replica.cc:330] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: stopping tablet replica
I20260811 01:33:18.042358 4791 raft_consensus.cc:2229] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:33:18.043213 4791 raft_consensus.cc:2258] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:33:18.045297 4791 ts_tablet_manager.cc:1905] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:33:18.052675 4791 ts_tablet_manager.cc:1918] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:33:18.052942 4791 log.cc:1196] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/fc18a4666f5d4f8cae71f8aca36b3a09
I20260811 01:33:18.054930 4791 ts_tablet_manager.cc:1939] T fc18a4666f5d4f8cae71f8aca36b3a09 P de559e9653044d03b426db02c7db0cc5: Deleting consensus metadata
I20260811 01:33:18.057039 4154 catalog_manager.cc:4841] TS de559e9653044d03b426db02c7db0cc5 (127.23.39.195:41995): tablet fc18a4666f5d4f8cae71f8aca36b3a09 (table test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]) successfully deleted
I20260811 01:33:18.067291 4788 tablet_replica.cc:330] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: stopping tablet replica
I20260811 01:33:18.067921 4788 raft_consensus.cc:2229] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:33:18.068607 4788 raft_consensus.cc:2258] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:33:18.072152 4789 tablet_replica.cc:330] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: stopping tablet replica
I20260811 01:33:18.072726 4789 raft_consensus.cc:2229] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:33:18.073268 4789 raft_consensus.cc:2258] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:33:18.075060 4788 ts_tablet_manager.cc:1905] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:33:18.075587 4789 ts_tablet_manager.cc:1905] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 01:33:18 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:33:18.082679 4788 ts_tablet_manager.cc:1918] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:33:18.082875 4788 log.cc:1196] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/fc18a4666f5d4f8cae71f8aca36b3a09
I20260811 01:33:18.083300 4789 ts_tablet_manager.cc:1918] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:33:18.083458 4788 ts_tablet_manager.cc:1939] T fc18a4666f5d4f8cae71f8aca36b3a09 P 0b26e52e11304be7891c8883aaaed44c: Deleting consensus metadata
I20260811 01:33:18.083487 4789 log.cc:1196] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/fc18a4666f5d4f8cae71f8aca36b3a09
I20260811 01:33:18.084049 4789 ts_tablet_manager.cc:1939] T fc18a4666f5d4f8cae71f8aca36b3a09 P a5f8dc8f6f044f2c9477a9086bef0730: Deleting consensus metadata
I20260811 01:33:18.085423 4156 catalog_manager.cc:4841] TS 0b26e52e11304be7891c8883aaaed44c (127.23.39.194:45501): tablet fc18a4666f5d4f8cae71f8aca36b3a09 (table test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]) successfully deleted
I20260811 01:33:18.085757 4154 catalog_manager.cc:4841] TS a5f8dc8f6f044f2c9477a9086bef0730 (127.23.39.193:40877): tablet fc18a4666f5d4f8cae71f8aca36b3a09 (table test-table [id=3f3db1777cc64a1db56ff99110f6cd5f]) successfully deleted
I20260811 01:33:18.086054 4773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:18.035621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47530 (local address 127.23.39.193:40877)
0811 01:33:18.035880 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:18.035889 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:18.058039 (+ 22150us) server_negotiation.cc:407] Connection header received
0811 01:33:18.058716 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:18.058726 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:18.058847 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:18.058944 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:18.061477 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.063126 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.069198 (+ 6072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.070209 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.070356 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:18.077266 (+ 6910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:18.077283 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:18.077300 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:18.077357 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:18.081514 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.082497 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.082507 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.082510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.082695 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.083446 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.083455 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.083461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.084077 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:18.084444 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:18.085313 (+ 869us) server_negotiation.cc:299] Negotiation successful
0811 01:33:18.085698 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 01:33:18.087554 4409 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:33:18.180280 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 4267
I20260811 01:33:18.201987 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 4422
Aug 11 01:33:18 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:33:18.218674 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:18.203025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47966 (local address 127.23.39.194:45501)
0811 01:33:18.203243 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:18.203248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:18.203271 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:33:18.203449 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:18.203460 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:18.203525 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:18.203638 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:18.204977 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.205746 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.207206 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.207652 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.207825 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:18.212345 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:18.212360 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:18.212384 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:18.212422 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:18.215486 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.216205 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.216213 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.216215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.216381 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.216782 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.216788 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.216791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.217227 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:18.217543 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:18.217871 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 01:33:18.218389 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:33:18.219350 4572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:33:18.315137 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 4422
I20260811 01:33:18.337638 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 4586
Aug 11 01:33:18 dist-test-slave-9jjr krb5kdc[3620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786411993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:33:18.355366 4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:33:18.338421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59426 (local address 127.23.39.195:41995)
0811 01:33:18.338666 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 01:33:18.338674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:33:18.338722 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:33:18.338933 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:33:18.338938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:33:18.339034 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:33:18.339166 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:33:18.340790 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.341636 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.343132 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:33:18.343620 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:33:18.343764 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:33:18.348738 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:33:18.348754 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:33:18.348772 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:33:18.348814 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:33:18.352341 (+ 3527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.353093 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.353106 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.353108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.353255 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:33:18.353639 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:33:18.353645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:33:18.353648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:33:18.354098 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:33:18.354505 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0811 01:33:18.354790 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 01:33:18.355032 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 01:33:18.356078 4731 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:33:18.483983 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 4586
I20260811 01:33:18.507386 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 4136
I20260811 01:33:18.508617 4206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:33:18.622644 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 4136
I20260811 01:33:18.648520 23711 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:33:18.994529 23711 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:33:18.994864 23711 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:33:19.340795 23711 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:33:19.341 UTC [3653] LOG: received smart shutdown request
2026-08-11 01:33:19.345 UTC [3653] LOG: background worker "logical replication launcher" (PID 3664) exited with exit code 1
2026-08-11 01:33:19.346 UTC [3657] LOG: shutting down
2026-08-11 01:33:19.532 UTC [3653] LOG: database system is shut down
2026-08-11T01:33:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53891 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:33:19 dist-test-slave-9jjr krb5kdc[4806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:33:19 dist-test-slave-9jjr krb5kdc[4806](info): set up 2 sockets
Aug 11 01:33:19 dist-test-slave-9jjr krb5kdc[4806](info): commencing operation
krb5kdc: starting...
W20260811 01:33:20.884716 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:33:21 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:33:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:33:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangeradmin_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangeradmin_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangerlookup_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangerlookup_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
I20260811 01:33:21.330302 23711 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuc9edm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/postgres -l logfile start
2026-08-11 01:33:23.993 UTC [4838] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 01:33:23.993 UTC [4838] LOG: listening on IPv4 address "127.23.39.212", port 37197
2026-08-11 01:33:23.997 UTC [4838] LOG: listening on Unix socket "/tmp/.s.PGSQL.37197"
2026-08-11 01:33:24.019 UTC [4841] LOG: database system was shut down at 2026-08-11 01:33:22 UTC
2026-08-11 01:33:24.023 UTC [4838] LOG: database system is ready to accept connections
I20260811 01:33:25.094709 23711 mini_postgres.cc:96] Postgres bound to 37197
2026-08-11 01:33:25.120 UTC [4854] FATAL: database "slave" does not exist
127.23.39.212:37197 - accepting connections
I20260811 01:33:25.120950 23711 mini_ranger.cc:161] Starting Ranger...
I20260811 01:33:25.156180 23711 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 01:33:25.734061 23711 mini_ranger.cc:87] Created ranger Postgres database
I20260811 01:33:25.734264 23711 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin
2026-08-11 01:33:26,056 [I] DB FLAVOR :POSTGRES
2026-08-11 01:33:26,057 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:33:26,057 [I] Checking connection..
2026-08-11 01:33:26,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 01:33:26,309 [I] Checking connection passed.
2026-08-11 01:33:26,310 [I] --------- Verifying version history table ---------
2026-08-11 01:33:26,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:33:26,560 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:33:26,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:33:26,820 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 01:33:26,821 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 01:33:26,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 01:33:27.099 UTC [4925] WARNING: there is no transaction in progress
2026-08-11 01:33:27,107 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 01:33:27,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 01:33:27,361 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 01:33:27,361 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:33:27,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 01:33:27,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 01:33:27,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-9jjr.c.gcp-upstream.internal','N') ;"
2026-08-11 01:33:28,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:33:28,407 [I] Table x_portal_user does not exist in database ranger
2026-08-11 01:33:28,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:33:28,678 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 01:33:28,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:33:28,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:33:29,221 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 01:33:29,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 01:33:30.271 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.289 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.308 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.327 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.344 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.365 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.426 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.434 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.451 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.462 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.473 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.488 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.498 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.506 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.514 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:30.522 UTC [5049] WARNING: there is no transaction in progress
2026-08-11 01:33:31,245 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 01:33:31,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 01:33:31,491 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 01:33:31,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 01:33:31,766 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 01:33:31,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 01:33:32,044 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 01:33:32,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 01:33:32,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 01:33:32,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-9jjr.c.gcp-upstream.internal';"
2026-08-11 01:33:32,800 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 01:33:32,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 01:33:33,072 [I] DB_PATCHES have already been applied
I20260811 01:33:33.078732 23711 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuc9edm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 01:33:33.078879 23711 mini_ranger.cc:193] Using host: 127.23.39.212
I20260811 01:33:33.100524 23711 mini_ranger.cc:227] Ranger admin URL: http://127.23.39.212:58349
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 1:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 01:33:34.367329 23711 mini_ranger.cc:160] Time spent starting Ranger: real 9.246s user 0.003s sys 0.067s
Aug 11, 2026 1:33:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 1:33:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 1:33:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 1:33:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 1:33:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 01:33:56.794627 23711 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.39.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.39.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangerkms_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.39.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/rangerkms_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.39.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.39.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.39.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/HTTP_127.23.39.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 01:33:57 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412037, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 01:33:57.032519 23711 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 01:33:57.063742 23711 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 01:33:58.013942 23711 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 01:33:58.014047 23711 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms
I20260811 01:33:58.014199 23711 mini_ranger_kms.cc:227] Using postgres at 127.23.39.212:37197
2026-08-11 01:33:58,405 [I] DB FLAVOR :POSTGRES
2026-08-11 01:33:58,405 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 01:33:58,405 [I] Checking connection
2026-08-11 01:33:58,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 01:33:58,654 [I] connection success
2026-08-11 01:33:58,654 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 01:33:58,654 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 01:33:58,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 01:33:58,924 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 01:33:58,924 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 01:33:58,925 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 01:33:58,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.39.212:37197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 01:33:59,200 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 01:33:59.728928 23711 mini_ranger_kms.cc:310] Created kms service
I20260811 01:33:59.959267 23711 mini_ranger_kms.cc:326] Created kudu user
I20260811 01:34:00.007975 23711 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 01:34:00 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412037, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:00.458550 23711 mini_ranger_kms.cc:384] Added ranger policy
I20260811 01:34:00.458904 23711 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuc9edm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuc9edm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 01:34:00.458963 23711 mini_ranger_kms.cc:240] Using host: 127.23.39.212
I20260811 01:34:00.483423 23711 mini_ranger_kms.cc:276] Ranger KMS PID: 5251
I20260811 01:34:00.483569 23711 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.39.212:57379
Aug 11, 2026 1:34:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 1:34:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 1:34:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 1:34:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 1:34:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 1:34:02 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 01:34:02 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412042, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:03.014263 23711 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.982s user 0.101s sys 0.336s
I20260811 01:34:03.014545 23711 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 01:34:03.014753 23711 mini_ranger_kms.cc:401] 127.23.39.212:57379/kms/v1/keys
Aug 11 01:34:03 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412042, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
Aug 11 01:34:03 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412042, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.39.212@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
Aug 11 01:34:05 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:34:05.979424 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38177
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:38177
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:06.351313 5310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:06.351636 5310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:06.351805 5310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:06.359299 5310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:06.359426 5310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:06.359521 5310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:06.359620 5310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:06.359697 5310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:06.370471 5310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.39.212:57379/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:38177
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:06.371860 5310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:06.373252 5310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:06.385983 5316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:06.385983 5317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:06.386207 5319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:06.386548 5310 server_base.cc:1034] running on GCE node
I20260811 01:34:06.387576 5310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:06.389236 5310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:06.390478 5310 hybrid_clock.cc:648] HybridClock initialized: now 1786412046390436 us; error 33 us; skew 500 ppm
I20260811 01:34:06.390849 5310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:06 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412046, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:06.400830 5310 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:06.402959 5310 webserver.cc:460] Webserver started at http://127.23.39.254:46607/ using document root <none> and password file <none>
I20260811 01:34:06.403684 5310 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:06.403788 5310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:06.404057 5310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:34:06 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412046, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:06.458809 5310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "19d014c8f1464c548514683729756d83"
format_stamp: "Formatted at 2026-08-11 01:34:06 on dist-test-slave-9jjr"
server_key: "e2803a6a51d9a42f5a2bacd26497fc33"
server_key_iv: "f0ff9b087c08974fc434328550e699ef"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:06.459744 5310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "19d014c8f1464c548514683729756d83"
format_stamp: "Formatted at 2026-08-11 01:34:06 on dist-test-slave-9jjr"
server_key: "e2803a6a51d9a42f5a2bacd26497fc33"
server_key_iv: "f0ff9b087c08974fc434328550e699ef"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:06.465741 5310 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:34:06.483188 5328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:06.484803 5310 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:34:06.485023 5310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "19d014c8f1464c548514683729756d83"
format_stamp: "Formatted at 2026-08-11 01:34:06 on dist-test-slave-9jjr"
server_key: "e2803a6a51d9a42f5a2bacd26497fc33"
server_key_iv: "f0ff9b087c08974fc434328550e699ef"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:06.485282 5310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:06.505120 5310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:06.509446 5310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:06.509790 5310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:06.529405 5310 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:38177
I20260811 01:34:06.529420 5384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:38177 every 8 connection(s)
I20260811 01:34:06.530936 5310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:06.533838 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 5310
I20260811 01:34:06.534072 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:34:06.535027 23711 external_mini_cluster.cc:1428] Setting key c8aa10407bf38e05700186f84ebdd619
I20260811 01:34:06.535642 5385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:06.550805 5385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Bootstrap starting.
Aug 11 01:34:06 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:06.554320 5385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:06.555498 5385 log.cc:824] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:06.558869 5385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: No bootstrap required, opened a new log
I20260811 01:34:06.559653 5388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:06.537244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.23.39.254:38177)
0811 01:34:06.538211 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:06.538223 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:06.538263 (+ 40us) server_negotiation.cc:407] Connection header received
0811 01:34:06.540511 (+ 2248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:06.540532 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:06.540925 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:06.541251 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:06.543162 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:06.544515 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:06.546515 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:06.547240 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:06.547387 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:06.552078 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:06.552086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:06.552101 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:06.552138 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:06.555361 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:06.556165 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:06.556177 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:06.556183 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:06.556351 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:06.556763 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:06.556767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:06.556769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:06.557286 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:06.557607 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:06.558085 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 01:34:06.558517 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":492,"threads_started":1}
I20260811 01:34:06.567425 5385 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:06.567852 5385 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:06.567961 5385 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d014c8f1464c548514683729756d83, State: Initialized, Role: FOLLOWER
I20260811 01:34:06.568657 5385 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:06.568948 5385 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:06.569095 5385 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:06.569303 5385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:06.571604 5385 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:06.572055 5385 leader_election.cc:302] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19d014c8f1464c548514683729756d83; no voters:
I20260811 01:34:06.572638 5385 leader_election.cc:288] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:34:06.572811 5390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:06.573505 5390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 LEADER]: Becoming Leader. State: Replica: 19d014c8f1464c548514683729756d83, State: Running, Role: LEADER
I20260811 01:34:06.574079 5390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:06.574896 5385 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:06.576957 5391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19d014c8f1464c548514683729756d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } } }
I20260811 01:34:06.577356 5391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:06.577885 5393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19d014c8f1464c548514683729756d83. Latest consensus state: current_term: 1 leader_uuid: "19d014c8f1464c548514683729756d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } } }
I20260811 01:34:06.578233 5393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:06.578459 5398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:06.584640 5398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:06.585450 5385 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 01:34:06.609100 5398 catalog_manager.cc:1347] Generated new cluster ID: ce43d3ab10ae436a9865e3eac1479716
I20260811 01:34:06.609335 5398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:06.633138 5398 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:34:06.635398 5398 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:06.646075 5398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Generated new TSK 0
I20260811 01:34:06.647373 5398 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:34:07.446638 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:07 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 01:34:07.897470 5432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:07.897836 5432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:07.898012 5432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:07.906024 5432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:07.906205 5432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:07.906432 5432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:07.917192 5432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:07.918802 5432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:07.920267 5432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:07.939633 5444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:07.940893 5445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:07.949803 5432 server_base.cc:1034] running on GCE node
W20260811 01:34:07.950330 5447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:07.951339 5432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:07.952864 5432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:07.954273 5432 hybrid_clock.cc:648] HybridClock initialized: now 1786412047954180 us; error 77 us; skew 500 ppm
I20260811 01:34:07.954674 5432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:07 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:07.959359 5432 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:07.964135 5432 webserver.cc:460] Webserver started at http://127.23.39.193:36603/ using document root <none> and password file <none>
I20260811 01:34:07.965191 5432 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:07.965411 5432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:07.965853 5432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:34:07 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:07.990530 5432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "c5a14e2b126648aea52178a4f7ea0937"
format_stamp: "Formatted at 2026-08-11 01:34:07 on dist-test-slave-9jjr"
server_key: "65fa9780409395a7ffd8ea9cd3ed61d9"
server_key_iv: "9b1c1ca96e119617aca09d3078efd368"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:07.991910 5432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "c5a14e2b126648aea52178a4f7ea0937"
format_stamp: "Formatted at 2026-08-11 01:34:07 on dist-test-slave-9jjr"
server_key: "65fa9780409395a7ffd8ea9cd3ed61d9"
server_key_iv: "9b1c1ca96e119617aca09d3078efd368"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:07.999164 5432 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 01:34:08.017959 5456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.020237 5432 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 01:34:08.020460 5432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "c5a14e2b126648aea52178a4f7ea0937"
format_stamp: "Formatted at 2026-08-11 01:34:07 on dist-test-slave-9jjr"
server_key: "65fa9780409395a7ffd8ea9cd3ed61d9"
server_key_iv: "9b1c1ca96e119617aca09d3078efd368"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:08.020750 5432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:08.062885 5432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:08.068871 5432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:08.069329 5432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:08.075246 5432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:08.077515 5432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:08.077634 5432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.077893 5432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:08.078025 5432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.187403 5432 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:45205
I20260811 01:34:08.187422 5592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:45205 every 8 connection(s)
I20260811 01:34:08.189325 5432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:08.195305 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 5432
I20260811 01:34:08.195528 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:34:08.196357 23711 external_mini_cluster.cc:1428] Setting key 4fd0bdaa6ab9bf8dd5f2c0b6f9c74bf3
Aug 11 01:34:08 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Aug 11 01:34:08 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:08.282608 5597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:08.194970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60103 (local address 127.23.39.254:38177)
0811 01:34:08.220243 (+ 25273us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:08.220254 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:08.228272 (+ 8018us) server_negotiation.cc:407] Connection header received
0811 01:34:08.238370 (+ 10098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:08.238377 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:08.238505 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:08.238602 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:08.248022 (+ 9420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:08.249190 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:08.252823 (+ 3633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:08.253477 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:08.253582 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:08.273567 (+ 19985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:08.273574 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:08.273579 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:08.273629 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:08.277171 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:08.278397 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:08.278406 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:08.278413 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:08.278598 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:08.279248 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:08.279257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:08.279263 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:08.279675 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:08.279835 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:08.281801 (+ 1966us) server_negotiation.cc:299] Negotiation successful
0811 01:34:08.282067 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25057,"thread_start_us":25266,"threads_started":1}
I20260811 01:34:08.284621 5595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:08.193774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.193:60103)
0811 01:34:08.228054 (+ 34280us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:08.228111 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:08.235654 (+ 7543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:08.239322 (+ 3668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:08.239336 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:08.240044 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:08.241159 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:08.241210 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:08.249484 (+ 8274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:08.249490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:08.252578 (+ 3088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:08.252610 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:08.254822 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:08.254837 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:08.255203 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:08.269813 (+ 14610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:08.269860 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:08.273171 (+ 3311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:08.277368 (+ 4197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:08.277384 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:08.277410 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:08.278214 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:08.278750 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:08.278758 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:08.278765 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:08.279084 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:08.279931 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:08.279944 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:08.280517 (+ 573us) client_negotiation.cc:769] Sending connection context
0811 01:34:08.280916 (+ 399us) client_negotiation.cc:240] Negotiation successful
0811 01:34:08.282998 (+ 2082us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33947,"thread_start_us":33689,"threads_started":1}
I20260811 01:34:08.286993 5593 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:08.287344 5593 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:08.288271 5593 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:08.291074 5347 ts_manager.cc:194] Registered new tserver with Master: c5a14e2b126648aea52178a4f7ea0937 (127.23.39.193:45205)
I20260811 01:34:08.292793 5347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:60103
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
W20260811 01:34:08.309513 23711 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.23.39.194: real 0.109s user 0.004s sys 0.023s
I20260811 01:34:08.310424 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:08 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412047, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
W20260811 01:34:08.805709 5600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:08.806185 5600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:08.806350 5600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:08.818159 5600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:08.818387 5600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:08.818604 5600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:08.834832 5600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:08.836719 5600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:08.838466 5600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:08.857558 5612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:08.857667 5611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:08.859223 5600 server_base.cc:1034] running on GCE node
W20260811 01:34:08.859278 5618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:08.860069 5600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:08.861132 5600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:08.862372 5600 hybrid_clock.cc:648] HybridClock initialized: now 1786412048862311 us; error 55 us; skew 500 ppm
I20260811 01:34:08.862717 5600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:08 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412048, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:08.866045 5600 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:08.867622 5600 webserver.cc:460] Webserver started at http://127.23.39.194:34525/ using document root <none> and password file <none>
I20260811 01:34:08.868361 5600 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:08.868515 5600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:08.868844 5600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:34:08 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412048, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:08.887205 5600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "7f3afdd22c784f5f9ec0210e4836c323"
format_stamp: "Formatted at 2026-08-11 01:34:08 on dist-test-slave-9jjr"
server_key: "65d8ad3b8958493bc325ee6b442d2111"
server_key_iv: "ff05b6774559958eb190862ab1717253"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:08.888480 5600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "7f3afdd22c784f5f9ec0210e4836c323"
format_stamp: "Formatted at 2026-08-11 01:34:08 on dist-test-slave-9jjr"
server_key: "65d8ad3b8958493bc325ee6b442d2111"
server_key_iv: "ff05b6774559958eb190862ab1717253"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:08.896173 5600 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.007s
I20260811 01:34:08.916007 5626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.917753 5600 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:34:08.917955 5600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "7f3afdd22c784f5f9ec0210e4836c323"
format_stamp: "Formatted at 2026-08-11 01:34:08 on dist-test-slave-9jjr"
server_key: "65d8ad3b8958493bc325ee6b442d2111"
server_key_iv: "ff05b6774559958eb190862ab1717253"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:08.918243 5600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:08.937908 5600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:08.943405 5600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:08.943784 5600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:08.945071 5600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:08.946710 5600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:08.946784 5600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.946944 5600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:08.947019 5600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:08.987306 5600 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35713
I20260811 01:34:08.987341 5751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35713 every 8 connection(s)
I20260811 01:34:08.988655 5600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:08.993558 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 5600
I20260811 01:34:08.993767 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:34:08.994474 23711 external_mini_cluster.cc:1428] Setting key 4ff28711a3726311e90fc4416e070b3b
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412048, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:09.018767 5755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:08.991655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:43505 (local address 127.23.39.254:38177)
0811 01:34:08.992170 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:08.992177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:08.998222 (+ 6045us) server_negotiation.cc:407] Connection header received
0811 01:34:08.998305 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:08.998312 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:08.998420 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:08.998543 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:09.000714 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.001891 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.004543 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.005262 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.005415 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.010328 (+ 4913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:09.010336 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:09.010342 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:09.010388 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:09.014408 (+ 4020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.015490 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.015497 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.015501 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.015687 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.016276 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.016282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.016286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.016700 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:09.016847 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:09.018015 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0811 01:34:09.018317 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":251,"threads_started":1}
I20260811 01:34:09.021324 5756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:08.992252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.194:43505)
0811 01:34:08.995215 (+ 2963us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:08.995282 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:08.997967 (+ 2685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:08.998860 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:08.998874 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:08.999546 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:09.000481 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:09.000508 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.002086 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.002093 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:09.004367 (+ 2274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:09.004385 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.005551 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.005560 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:09.005894 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.006804 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:09.006838 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:09.009992 (+ 3154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:09.014615 (+ 4623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:09.014626 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:09.014647 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:09.015331 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:09.015857 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:09.015862 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:09.015867 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:09.016128 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:09.016962 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:09.016972 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:09.017504 (+ 532us) client_negotiation.cc:769] Sending connection context
0811 01:34:09.019114 (+ 1610us) client_negotiation.cc:240] Negotiation successful
0811 01:34:09.019776 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":339,"threads_started":1}
I20260811 01:34:09.023013 5752 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:09.023397 5752 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:09.024348 5752 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
I20260811 01:34:09.026014 5347 ts_manager.cc:194] Registered new tserver with Master: 7f3afdd22c784f5f9ec0210e4836c323 (127.23.39.194:35713)
I20260811 01:34:09.026953 5347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:43505
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:34:09.062225 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:09.296128 5593 heartbeater.cc:503] Master 127.23.39.254:38177 was elected leader, sending a full tablet report...
W20260811 01:34:09.411609 5759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:09.412123 5759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:09.412317 5759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:09.420171 5759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:09.420305 5759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:09.420504 5759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:09.430998 5759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:09.432452 5759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:09.433840 5759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:09.447598 5764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:09.447682 5765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:09.447638 5767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:09.448660 5759 server_base.cc:1034] running on GCE node
I20260811 01:34:09.449282 5759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:09.450373 5759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:09.451627 5759 hybrid_clock.cc:648] HybridClock initialized: now 1786412049451576 us; error 51 us; skew 500 ppm
I20260811 01:34:09.451980 5759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412049, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:09.455550 5759 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:09.457126 5759 webserver.cc:460] Webserver started at http://127.23.39.195:40169/ using document root <none> and password file <none>
I20260811 01:34:09.457846 5759 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:09.457985 5759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:09.458406 5759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412049, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:09.475982 5759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "ba1a074b81434f9f90bd76496cd387ff"
format_stamp: "Formatted at 2026-08-11 01:34:09 on dist-test-slave-9jjr"
server_key: "333a78960c89161001d9ed9ad2482e30"
server_key_iv: "92117b58e7e4b89105f5b256ac88a397"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:09.477010 5759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "ba1a074b81434f9f90bd76496cd387ff"
format_stamp: "Formatted at 2026-08-11 01:34:09 on dist-test-slave-9jjr"
server_key: "333a78960c89161001d9ed9ad2482e30"
server_key_iv: "92117b58e7e4b89105f5b256ac88a397"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:09.483217 5759 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 01:34:09.502081 5776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:09.503782 5759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:34:09.503973 5759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "ba1a074b81434f9f90bd76496cd387ff"
format_stamp: "Formatted at 2026-08-11 01:34:09 on dist-test-slave-9jjr"
server_key: "333a78960c89161001d9ed9ad2482e30"
server_key_iv: "92117b58e7e4b89105f5b256ac88a397"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:09.504240 5759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:09.519824 5759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:09.524374 5759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:09.524691 5759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:09.525642 5759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:09.527251 5759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:09.527356 5759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:09.527503 5759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:09.527580 5759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:09.561926 5759 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:45773
I20260811 01:34:09.561980 5911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:45773 every 8 connection(s)
I20260811 01:34:09.563323 5759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:09.573035 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 5759
I20260811 01:34:09.573235 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:34:09.573715 23711 external_mini_cluster.cc:1428] Setting key 191052bc26a33c3a2bf3c7b0f862041a
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412049, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:09.584211 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:09.566105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:37623 (local address 127.23.39.254:38177)
0811 01:34:09.566705 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:09.566709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:09.567612 (+ 903us) server_negotiation.cc:407] Connection header received
0811 01:34:09.569441 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:09.569446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:09.569550 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:09.569697 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:09.571191 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.571946 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.573647 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.574180 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.574328 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.578176 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:09.578182 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:09.578187 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:09.578229 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:09.581061 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.581799 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.581804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.581807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.581952 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.582443 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.582449 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.582453 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.582741 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:09.582916 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:09.583608 (+ 692us) server_negotiation.cc:299] Negotiation successful
0811 01:34:09.583838 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":280,"threads_started":1}
I20260811 01:34:09.585139 5915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:09.566715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.195:37623)
0811 01:34:09.567433 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:09.567475 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:09.569132 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:09.569937 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:09.569945 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:09.570436 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:09.571014 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:09.571032 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.572111 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.572117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:09.573503 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:09.573516 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.574449 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.574459 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:09.574738 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.575539 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:09.575562 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:09.577947 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:09.581205 (+ 3258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:09.581214 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:09.581230 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:09.581658 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:09.582068 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:09.582072 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:09.582076 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:09.582328 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:09.582883 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:09.582891 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:09.583247 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 01:34:09.583511 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 01:34:09.584024 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":291,"threads_started":1}
I20260811 01:34:09.586542 5912 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:09.586907 5912 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:09.587610 5912 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:09.589366 5346 ts_manager.cc:194] Registered new tserver with Master: ba1a074b81434f9f90bd76496cd387ff (127.23.39.195:45773)
I20260811 01:34:09.590580 5346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:37623
I20260811 01:34:09.601918 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:34:09.603744 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 5432
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:34:09.621634 5917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:09.604776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33880 (local address 127.23.39.193:45205)
0811 01:34:09.605363 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:09.605370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:09.605397 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:34:09.605544 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:09.605551 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:09.605781 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:09.605916 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:09.607636 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.608791 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.610318 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.610920 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.611026 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.615878 (+ 4852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:09.615892 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:09.615907 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:09.615946 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:09.618930 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.619654 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.619661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.619663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.619815 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.620159 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.620162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.620165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.620491 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:09.620747 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:09.621008 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 01:34:09.621240 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":290,"threads_started":1}
I20260811 01:34:09.623018 5587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:09.707777 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 5432
I20260811 01:34:09.729951 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 5600
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:34:09.748315 5919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:09.731023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37948 (local address 127.23.39.194:35713)
0811 01:34:09.731697 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:09.731705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:09.731734 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:34:09.731803 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:09.731810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:09.732040 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:09.732196 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:09.733402 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.734659 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.736170 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.736808 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.736922 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.741530 (+ 4608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:09.741546 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:09.741561 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:09.741604 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:09.744804 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.745692 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.745701 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.745703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.745862 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.746366 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.746372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.746377 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.746822 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:09.747190 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:09.747538 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 01:34:09.747876 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":371,"threads_started":1}
I20260811 01:34:09.749728 5747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:09.834926 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 5600
I20260811 01:34:09.854915 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 5759
Aug 11 01:34:09 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:34:09.872608 5921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:09.855935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39948 (local address 127.23.39.195:45773)
0811 01:34:09.856606 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:09.856613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:09.856642 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:34:09.856712 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:09.856718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:09.856937 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:09.857115 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:09.858636 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.859650 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.860996 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:09.861569 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:09.861723 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:09.866777 (+ 5054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:09.866789 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:09.866803 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:09.866843 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:09.869614 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.870391 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.870400 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.870405 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.870553 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:09.870950 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:09.870954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:09.870959 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:09.871332 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:09.871696 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:09.871958 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 01:34:09.872245 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":360,"threads_started":1}
I20260811 01:34:09.873974 5907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:09.959143 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 5759
I20260811 01:34:09.978093 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 5310
I20260811 01:34:09.979478 5379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:10.089802 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 5310
I20260811 01:34:10.116163 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38177
--webserver_interface=127.23.39.254
--webserver_port=46607
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:38177
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:10.481173 5926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:10.481606 5926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:10.481767 5926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:10.491084 5926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:10.491243 5926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:10.491314 5926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:10.491386 5926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:10.491436 5926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:10.501936 5926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:38177
--ranger_config_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=46607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:10.503296 5926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:10.504603 5926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:10.516466 5935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:10.516494 5932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:10.520217 5931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:10.521250 5926 server_base.cc:1034] running on GCE node
I20260811 01:34:10.522243 5926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:10.523720 5926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:10.524953 5926 hybrid_clock.cc:648] HybridClock initialized: now 1786412050524906 us; error 44 us; skew 500 ppm
I20260811 01:34:10.525310 5926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:10 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412050, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:10.528522 5926 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:10.530020 5926 webserver.cc:460] Webserver started at http://127.23.39.254:46607/ using document root <none> and password file <none>
I20260811 01:34:10.530720 5926 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:10.530879 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:34:10 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412050, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:10.617594 5926 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:34:10.621591 5944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:10.623508 5926 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260811 01:34:10.623751 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "19d014c8f1464c548514683729756d83"
format_stamp: "Formatted at 2026-08-11 01:34:06 on dist-test-slave-9jjr"
server_key: "e2803a6a51d9a42f5a2bacd26497fc33"
server_key_iv: "f0ff9b087c08974fc434328550e699ef"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:10.625216 5926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:10.663487 5926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:10.668726 5926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:10.669057 5926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:10.688565 5926 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:38177
I20260811 01:34:10.688585 6003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:38177 every 8 connection(s)
I20260811 01:34:10.690264 5926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:10.697435 6004 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:34:10.698681 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 5926
I20260811 01:34:10.699869 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:45205
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:38177
--webserver_port=36603
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:10.702541 6004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Bootstrap starting.
I20260811 01:34:10.725190 6004 log.cc:824] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:10.735131 6004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:34:10.735726 6004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Bootstrap complete.
I20260811 01:34:10.745193 6004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:10.746061 6004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d014c8f1464c548514683729756d83, State: Initialized, Role: FOLLOWER
I20260811 01:34:10.746888 6004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:10.747128 6004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:10.747246 6004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:10.747438 6004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:34:10.751398 6004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:10.751915 6004 leader_election.cc:302] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19d014c8f1464c548514683729756d83; no voters:
I20260811 01:34:10.752596 6004 leader_election.cc:288] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:34:10.752751 6009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:34:10.753942 6009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [term 2 LEADER]: Becoming Leader. State: Replica: 19d014c8f1464c548514683729756d83, State: Running, Role: LEADER
I20260811 01:34:10.754638 6009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } }
I20260811 01:34:10.754983 6004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:10.757416 6012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19d014c8f1464c548514683729756d83. Latest consensus state: current_term: 2 leader_uuid: "19d014c8f1464c548514683729756d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } } }
I20260811 01:34:10.757905 6012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:10.758472 6010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "19d014c8f1464c548514683729756d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19d014c8f1464c548514683729756d83" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38177 } } }
I20260811 01:34:10.758805 6010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:10.760696 6018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:10.767866 6018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:10.769428 6018 catalog_manager.cc:1259] Loaded cluster ID: ce43d3ab10ae436a9865e3eac1479716
I20260811 01:34:10.769601 6018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:10.773700 6018 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:10.775328 6018 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Loaded TSK: 0
I20260811 01:34:10.776922 6018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:34:10.780352 6004 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260811 01:34:11.182438 6006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:11.183004 6006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:11.183290 6006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:11.195106 6006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:11.195338 6006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:11.195566 6006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:11.211917 6006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:45205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=36603
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:11.213776 6006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:11.215641 6006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:11.241235 6047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:11.242776 6046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:11.252941 6049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:11.254053 6006 server_base.cc:1034] running on GCE node
I20260811 01:34:11.255045 6006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:11.256569 6006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:11.257936 6006 hybrid_clock.cc:648] HybridClock initialized: now 1786412051257861 us; error 62 us; skew 500 ppm
I20260811 01:34:11.258427 6006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:11 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:11.263748 6006 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:11.272770 6006 webserver.cc:460] Webserver started at http://127.23.39.193:36603/ using document root <none> and password file <none>
I20260811 01:34:11.273989 6006 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:11.274278 6006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:34:11 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:11.323204 6006 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.004s sys 0.004s
I20260811 01:34:11.328074 6058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:11.330395 6006 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:34:11.330614 6006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "c5a14e2b126648aea52178a4f7ea0937"
format_stamp: "Formatted at 2026-08-11 01:34:07 on dist-test-slave-9jjr"
server_key: "65fa9780409395a7ffd8ea9cd3ed61d9"
server_key_iv: "9b1c1ca96e119617aca09d3078efd368"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:11.331791 6006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:11.373813 6006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:11.379676 6006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:11.380100 6006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:11.386353 6006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:11.388445 6006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:11.388566 6006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:11.388676 6006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:11.388758 6006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:11.438179 6006 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:45205
I20260811 01:34:11.438216 6196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:45205 every 8 connection(s)
I20260811 01:34:11.439872 6006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:11.451129 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6006
I20260811 01:34:11.451972 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:35713
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:38177
--webserver_port=34525
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:11 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:11.477634 6200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:11.443775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.193:60075)
0811 01:34:11.444843 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:11.444886 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:11.448143 (+ 3257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:11.453124 (+ 4981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:11.453140 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:11.453886 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:11.454831 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:11.454870 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:11.457488 (+ 2618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:11.457497 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:11.459705 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:11.459730 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:11.461780 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:11.461790 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:11.462118 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:11.463120 (+ 1002us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:11.463165 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:11.466427 (+ 3262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:11.471908 (+ 5481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:11.471919 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:11.471937 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:11.472627 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:11.473273 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:11.473278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:11.473282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:11.473523 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:11.474759 (+ 1236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:11.474767 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:11.475186 (+ 419us) client_negotiation.cc:769] Sending connection context
0811 01:34:11.475506 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 01:34:11.476122 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":650,"threads_started":1}
I20260811 01:34:11.480373 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:11.443592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:60075 (local address 127.23.39.254:38177)
0811 01:34:11.444362 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:11.444376 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:11.445034 (+ 658us) server_negotiation.cc:407] Connection header received
0811 01:34:11.448939 (+ 3905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:11.448962 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:11.449505 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:11.449917 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:11.455139 (+ 5222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:11.457256 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:11.459941 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:11.461104 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:11.461337 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:11.466825 (+ 5488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:11.466840 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:11.466862 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:11.466922 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:11.471683 (+ 4761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:11.472843 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:11.472854 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:11.472864 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:11.473106 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:11.473691 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:11.473697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:11.473701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:11.474469 (+ 768us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:11.474677 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:11.478478 (+ 3801us) server_negotiation.cc:299] Negotiation successful
0811 01:34:11.478982 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":290,"threads_started":1}
I20260811 01:34:11.485400 6197 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:11.485783 6197 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:11.486903 6197 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
W20260811 01:34:11.490515 6197 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:38177 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:34:11.490751 6197 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:11.491034 6197 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:11.492311 6197 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:11.492583 6197 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
W20260811 01:34:11.493757 6197 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:34:11.896369 6201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:11.896811 6201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:11.897032 6201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:11.909085 6201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:11.909241 6201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:11.909425 6201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:11.925633 6201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:35713
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=34525
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:11.927383 6201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:11.929138 6201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:11.964484 6219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:11.964846 6217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:11.967972 6201 server_base.cc:1034] running on GCE node
W20260811 01:34:11.968396 6221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:11.969225 6201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:11.970289 6201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:11.971572 6201 hybrid_clock.cc:648] HybridClock initialized: now 1786412051971425 us; error 129 us; skew 500 ppm
I20260811 01:34:11.971946 6201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:11 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:11.975597 6201 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:12.000049 6201 webserver.cc:460] Webserver started at http://127.23.39.194:34525/ using document root <none> and password file <none>
I20260811 01:34:12.001135 6201 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:12.001325 6201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:12.032091 6201 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.006s sys 0.001s
I20260811 01:34:12.035967 6233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:12.037968 6201 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:34:12.038183 6201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "7f3afdd22c784f5f9ec0210e4836c323"
format_stamp: "Formatted at 2026-08-11 01:34:08 on dist-test-slave-9jjr"
server_key: "65d8ad3b8958493bc325ee6b442d2111"
server_key_iv: "ff05b6774559958eb190862ab1717253"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:12.039577 6201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:12.081667 6201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:12.087239 6201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:12.087637 6201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:12.089048 6201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:12.090947 6201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:12.091115 6201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 01:34:12.091262 6201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:12.091374 6201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:12.151475 6201 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:35713
I20260811 01:34:12.151523 6365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:35713 every 8 connection(s)
I20260811 01:34:12.153081 6201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:12.153569 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6201
I20260811 01:34:12.154615 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.39.212:57379/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:45773
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:38177
--webserver_port=40169
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:37275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412051, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:12.215322 6367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:12.162983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.194:37529)
0811 01:34:12.190806 (+ 27823us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:12.190877 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:12.193938 (+ 3061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:12.195364 (+ 1426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:12.195381 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:12.196136 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:12.196999 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:12.197025 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:12.198668 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:12.198674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:12.200832 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:12.200860 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:12.201958 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:12.201967 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:12.202324 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:12.203249 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:12.203280 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:12.206201 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:12.210348 (+ 4147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:12.210358 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:12.210374 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:12.210994 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:12.211501 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:12.211505 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:12.211509 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:12.211756 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:12.212555 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:12.212563 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:12.212983 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 01:34:12.213328 (+ 345us) client_negotiation.cc:240] Negotiation successful
0811 01:34:12.213902 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27400,"thread_start_us":31056,"threads_started":1}
I20260811 01:34:12.216583 6368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:12.163628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:37529 (local address 127.23.39.254:38177)
0811 01:34:12.189987 (+ 26359us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:12.189998 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:12.194120 (+ 4122us) server_negotiation.cc:407] Connection header received
0811 01:34:12.194583 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:12.194591 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:12.194708 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:12.194848 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:12.197218 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:12.198441 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:12.201021 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:12.201674 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:12.201816 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:12.206479 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:12.206486 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:12.206492 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:12.206534 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:12.210178 (+ 3644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:12.211164 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:12.211170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:12.211173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:12.211347 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:12.211917 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:12.211922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:12.211925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:12.212320 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:12.212475 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:12.215919 (+ 3444us) server_negotiation.cc:299] Negotiation successful
0811 01:34:12.216171 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26168,"thread_start_us":26368,"threads_started":1}
I20260811 01:34:12.219313 6366 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:12.219573 6366 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:12.220490 6366 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:12.222745 5963 ts_manager.cc:194] Registered new tserver with Master: 7f3afdd22c784f5f9ec0210e4836c323 (127.23.39.194:35713)
I20260811 01:34:12.224983 5963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:37529
I20260811 01:34:12.493924 6197 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:12.494575 6197 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:12.495823 5963 ts_manager.cc:194] Registered new tserver with Master: c5a14e2b126648aea52178a4f7ea0937 (127.23.39.193:45205)
I20260811 01:34:12.496984 5963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:60075
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
W20260811 01:34:12.647450 6369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:12.647876 6369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:12.648073 6369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:12.659612 6369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:12.659826 6369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:12.660020 6369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:12.675685 6369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:37275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.39.212:57379/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:45773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=40169
--tserver_master_addrs=127.23.39.254:38177
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:12.677398 6369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:12.679167 6369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:12.695510 6376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:12.705889 6377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:12.714301 6379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:12.714681 6369 server_base.cc:1034] running on GCE node
I20260811 01:34:12.715696 6369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:12.716892 6369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:12.718246 6369 hybrid_clock.cc:648] HybridClock initialized: now 1786412052718181 us; error 59 us; skew 500 ppm
I20260811 01:34:12.718592 6369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:12.721983 6369 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:12.723944 6369 webserver.cc:460] Webserver started at http://127.23.39.195:40169/ using document root <none> and password file <none>
I20260811 01:34:12.724681 6369 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:12.724908 6369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:12.762908 6369 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.003s sys 0.008s
I20260811 01:34:12.766355 6387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:12.767894 6369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:34:12.768086 6369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "ba1a074b81434f9f90bd76496cd387ff"
format_stamp: "Formatted at 2026-08-11 01:34:09 on dist-test-slave-9jjr"
server_key: "333a78960c89161001d9ed9ad2482e30"
server_key_iv: "92117b58e7e4b89105f5b256ac88a397"
server_key_version: "kuduclusterkey@0"
I20260811 01:34:12.769157 6369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:12.797447 6369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:12.802480 6369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:12.802846 6369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:12.805150 6369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:12.808658 6369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:12.808784 6369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:12.808934 6369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:12.809034 6369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 01:34:12 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for HTTP/127.23.39.212@KRBTEST.COM
I20260811 01:34:13.056316 6369 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:45773
I20260811 01:34:13.056406 6515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:45773 every 8 connection(s)
I20260811 01:34:13.058281 6369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:13.068183 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6369
Aug 11 01:34:13 dist-test-slave-9jjr krb5kdc[4806](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412052, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:13.099422 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.069781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.23.39.254:38177)
0811 01:34:13.080096 (+ 10315us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.080102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.080121 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:34:13.080182 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.080188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.080296 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.080408 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.082734 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.083883 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.085971 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.086736 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.087702 (+ 966us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.090539 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.090545 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.090550 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.090606 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.094449 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.095442 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.095448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.095452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.095595 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.096404 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.096409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.096413 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.096801 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.097450 (+ 649us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.098762 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.098998 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":810,"server-negotiator.queue_time_us":10185,"thread_start_us":10037,"threads_started":1}
I20260811 01:34:13.102984 6518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.062475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:37727 (local address 127.23.39.254:38177)
0811 01:34:13.066598 (+ 4123us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.066608 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.078186 (+ 11578us) server_negotiation.cc:407] Connection header received
0811 01:34:13.080777 (+ 2591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.080783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.080876 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.080958 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.085606 (+ 4648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.086898 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.089672 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.090400 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.090516 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.095210 (+ 4694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.095219 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.095224 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.095277 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.098983 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.099959 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.099964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.099967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.100143 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.100730 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.100737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.100742 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.101089 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.101211 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.102368 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.102598 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3937,"thread_start_us":3791,"threads_started":1}
I20260811 01:34:13.104948 6519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.061863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38177 (local address 127.23.39.195:37727)
0811 01:34:13.074911 (+ 13048us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.074979 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.080345 (+ 5366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.081622 (+ 1277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.081634 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.082649 (+ 1015us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:13.083506 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.083533 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.087137 (+ 3604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.087143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.089488 (+ 2345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.089505 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.090854 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.090862 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.091206 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.091924 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:13.091965 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:13.094900 (+ 2935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:13.099142 (+ 4242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:13.099151 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:13.099170 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:13.099817 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:13.100300 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:13.100306 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:13.100310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:13.100569 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:13.101332 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:13.101340 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:13.101862 (+ 522us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.103209 (+ 1347us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.103781 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12611,"thread_start_us":16606,"threads_started":1}
I20260811 01:34:13.106876 6516 heartbeater.cc:347] Connected to a master server at 127.23.39.254:38177
I20260811 01:34:13.107227 6516 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:13.108098 6516 heartbeater.cc:511] Master 127.23.39.254:38177 requested a full tablet report, sending...
I20260811 01:34:13.109726 5963 ts_manager.cc:194] Registered new tserver with Master: ba1a074b81434f9f90bd76496cd387ff (127.23.39.195:45773)
I20260811 01:34:13.110612 5963 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:37727
I20260811 01:34:13.115944 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:34:13.134534 6518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.119478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.23.39.254:38177)
0811 01:34:13.119664 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.119671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.120214 (+ 543us) server_negotiation.cc:407] Connection header received
0811 01:34:13.120364 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.120369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.120450 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.120550 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.122249 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.123369 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.124735 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.125424 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.125554 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.128207 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.128214 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.128219 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.128258 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.131812 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.132472 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.132477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.132481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.132645 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.133012 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.133018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.133028 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.133328 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.133580 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.133926 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.134192 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:34:13.139932 5963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:34:13.147812 5963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:34:13.178514 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.164949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:35713 (local address 127.0.0.1:37964)
0811 01:34:13.166666 (+ 1717us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.166727 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.167043 (+ 316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.168201 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.168208 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.168238 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:13.168711 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.168726 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.171444 (+ 2718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.171449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.174589 (+ 3140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.174612 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.177494 (+ 2882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.177501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.177729 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.177784 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.177927 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.178145 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"thread_start_us":1241,"threads_started":1}
I20260811 01:34:13.178719 6539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.164979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37964 (local address 127.23.39.194:35713)
0811 01:34:13.165669 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.165678 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.166859 (+ 1181us) server_negotiation.cc:407] Connection header received
0811 01:34:13.167347 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.167359 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.167677 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.167858 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:13.168974 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.171207 (+ 2233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.175577 (+ 4370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.176959 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.177037 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.177215 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.177997 (+ 782us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.178263 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":350,"threads_started":1}
I20260811 01:34:13.184011 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.165617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33884)
0811 01:34:13.175276 (+ 9659us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.175300 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.175421 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.176764 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.176771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.176805 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:13.177236 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.177251 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.179232 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.179237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.180610 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.180654 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.183218 (+ 2564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.183224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.183393 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.183427 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.183505 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.183628 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9481,"thread_start_us":9309,"threads_started":1}
I20260811 01:34:13.184583 6542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.166223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.23.39.193:45205)
0811 01:34:13.175744 (+ 9521us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.175757 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.175794 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:34:13.175920 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.175930 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.176198 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.176450 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:13.177447 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.179060 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.180838 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.182930 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.183148 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.183452 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.183563 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.183784 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9308,"thread_start_us":9092,"threads_started":1}
I20260811 01:34:13.188748 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.167216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:45773 (local address 127.0.0.1:39950)
0811 01:34:13.178996 (+ 11780us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.179017 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.179116 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.182003 (+ 2887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.182008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.182033 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:13.182260 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.182271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.184347 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.184355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.186093 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.186108 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.188012 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.188018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.188223 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.188270 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.188364 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.188501 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11688,"thread_start_us":16854,"threads_started":1}
I20260811 01:34:13.188268 6116 tablet_service.cc:1467] Processing CreateTablet for tablet 0096bbbc75c546318a1bd678e14c922f (DEFAULT_TABLE table=test-table [id=f124720ec01a4c0d82dfbd86d9ffae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:13.188947 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.168001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.23.39.195:45773)
0811 01:34:13.181508 (+ 13507us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.181517 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.181555 (+ 38us) server_negotiation.cc:407] Connection header received
0811 01:34:13.181639 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.181644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.181824 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.182019 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:13.182393 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.183821 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.186334 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.187825 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.187972 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.188200 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.188452 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.188613 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13323,"thread_start_us":13165,"threads_started":1}
I20260811 01:34:13.188271 6291 tablet_service.cc:1467] Processing CreateTablet for tablet 0096bbbc75c546318a1bd678e14c922f (DEFAULT_TABLE table=test-table [id=f124720ec01a4c0d82dfbd86d9ffae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:13.189774 6291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0096bbbc75c546318a1bd678e14c922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:13.189810 6116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0096bbbc75c546318a1bd678e14c922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:13.193738 6441 tablet_service.cc:1467] Processing CreateTablet for tablet 0096bbbc75c546318a1bd678e14c922f (DEFAULT_TABLE table=test-table [id=f124720ec01a4c0d82dfbd86d9ffae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:13.195312 6441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0096bbbc75c546318a1bd678e14c922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:13.201637 6545 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Bootstrap starting.
I20260811 01:34:13.205166 6546 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Bootstrap starting.
I20260811 01:34:13.206542 6545 tablet_bootstrap.cc:654] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:13.207927 6545 log.cc:824] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:13.208861 6546 tablet_bootstrap.cc:654] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:13.210043 6546 log.cc:824] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:13.210274 6548 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Bootstrap starting.
I20260811 01:34:13.212025 6545 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: No bootstrap required, opened a new log
I20260811 01:34:13.212323 6545 ts_tablet_manager.cc:1397] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260811 01:34:13.213724 6548 tablet_bootstrap.cc:654] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:13.213788 6546 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: No bootstrap required, opened a new log
I20260811 01:34:13.214027 6546 ts_tablet_manager.cc:1397] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:34:13.214919 6548 log.cc:824] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:13.217684 6548 tablet_bootstrap.cc:492] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: No bootstrap required, opened a new log
I20260811 01:34:13.217926 6548 ts_tablet_manager.cc:1397] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260811 01:34:13.223271 6545 raft_consensus.cc:348] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.223742 6545 raft_consensus.cc:374] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:13.223842 6545 raft_consensus.cc:729] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f3afdd22c784f5f9ec0210e4836c323, State: Initialized, Role: FOLLOWER
I20260811 01:34:13.224511 6545 consensus_queue.cc:260] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.224591 6546 raft_consensus.cc:348] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.225003 6546 raft_consensus.cc:374] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:13.225133 6546 raft_consensus.cc:729] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a14e2b126648aea52178a4f7ea0937, State: Initialized, Role: FOLLOWER
I20260811 01:34:13.225297 6548 raft_consensus.cc:348] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.225708 6548 raft_consensus.cc:374] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:13.225811 6548 raft_consensus.cc:729] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba1a074b81434f9f90bd76496cd387ff, State: Initialized, Role: FOLLOWER
I20260811 01:34:13.225941 6366 heartbeater.cc:503] Master 127.23.39.254:38177 was elected leader, sending a full tablet report...
I20260811 01:34:13.225842 6546 consensus_queue.cc:260] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.226473 6548 consensus_queue.cc:260] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.226676 6545 ts_tablet_manager.cc:1428] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260811 01:34:13.227730 6197 heartbeater.cc:503] Master 127.23.39.254:38177 was elected leader, sending a full tablet report...
I20260811 01:34:13.228760 6516 heartbeater.cc:503] Master 127.23.39.254:38177 was elected leader, sending a full tablet report...
I20260811 01:34:13.229462 6548 ts_tablet_manager.cc:1428] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Time spent starting tablet: real 0.011s user 0.004s sys 0.008s
I20260811 01:34:13.230484 6546 ts_tablet_manager.cc:1428] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
W20260811 01:34:13.329370 6517 tablet.cc:2369] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:13.339429 6552 raft_consensus.cc:482] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:13.339733 6552 raft_consensus.cc:504] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.341462 6552 leader_election.cc:288] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f3afdd22c784f5f9ec0210e4836c323 (127.23.39.194:35713), ba1a074b81434f9f90bd76496cd387ff (127.23.39.195:45773)
I20260811 01:34:13.349157 6539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.341999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:47777 (local address 127.23.39.194:35713)
0811 01:34:13.342265 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.342269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.342833 (+ 564us) server_negotiation.cc:407] Connection header received
0811 01:34:13.342939 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.342946 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.343031 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.343162 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:13.344008 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.344968 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.347103 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.348173 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.348299 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.348352 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.348781 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.348877 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:34:13.349318 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.341847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:35713 (local address 127.23.39.193:47777)
0811 01:34:13.342573 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.342594 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.342749 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.343358 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.343362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.343387 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:13.343835 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.343848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.345109 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.345114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.346957 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.346970 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.348392 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.348399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.348591 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.348627 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.348751 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.348893 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":406,"threads_started":1}
I20260811 01:34:13.350001 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.343048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54307 (local address 127.23.39.195:45773)
0811 01:34:13.343270 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.343277 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.343555 (+ 278us) server_negotiation.cc:407] Connection header received
0811 01:34:13.343749 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.343757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.343842 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.343949 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:13.344619 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.345613 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.347817 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.348887 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.349045 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.349120 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.349606 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.349748 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:34:13.350069 6556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.342776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:45773 (local address 127.23.39.193:54307)
0811 01:34:13.343439 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.343457 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:13.343613 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:13.343990 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:13.343994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:13.344018 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:13.344423 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.344434 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.345798 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.345802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.347644 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:13.347659 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.349120 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.349126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:13.349351 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.349384 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:34:13.349534 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 01:34:13.349677 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"spinlock_wait_cycles":23936,"thread_start_us":351,"threads_started":1}
I20260811 01:34:13.350538 6315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0096bbbc75c546318a1bd678e14c922f" candidate_uuid: "c5a14e2b126648aea52178a4f7ea0937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f3afdd22c784f5f9ec0210e4836c323" is_pre_election: true
I20260811 01:34:13.351213 6315 raft_consensus.cc:2454] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5a14e2b126648aea52178a4f7ea0937 in term 0.
I20260811 01:34:13.351197 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0096bbbc75c546318a1bd678e14c922f" candidate_uuid: "c5a14e2b126648aea52178a4f7ea0937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1a074b81434f9f90bd76496cd387ff" is_pre_election: true
I20260811 01:34:13.351720 6465 raft_consensus.cc:2454] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5a14e2b126648aea52178a4f7ea0937 in term 0.
I20260811 01:34:13.351930 6060 leader_election.cc:302] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f3afdd22c784f5f9ec0210e4836c323, c5a14e2b126648aea52178a4f7ea0937; no voters:
I20260811 01:34:13.352344 6552 raft_consensus.cc:2781] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:34:13.352512 6552 raft_consensus.cc:482] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:34:13.352649 6552 raft_consensus.cc:3037] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:13.355086 6552 raft_consensus.cc:504] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.355712 6552 leader_election.cc:288] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [CANDIDATE]: Term 1 election: Requested vote from peers 7f3afdd22c784f5f9ec0210e4836c323 (127.23.39.194:35713), ba1a074b81434f9f90bd76496cd387ff (127.23.39.195:45773)
I20260811 01:34:13.356300 6315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0096bbbc75c546318a1bd678e14c922f" candidate_uuid: "c5a14e2b126648aea52178a4f7ea0937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f3afdd22c784f5f9ec0210e4836c323"
I20260811 01:34:13.356333 6465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0096bbbc75c546318a1bd678e14c922f" candidate_uuid: "c5a14e2b126648aea52178a4f7ea0937" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba1a074b81434f9f90bd76496cd387ff"
I20260811 01:34:13.356535 6315 raft_consensus.cc:3037] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:13.356547 6465 raft_consensus.cc:3037] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:13.359858 6465 raft_consensus.cc:2454] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a14e2b126648aea52178a4f7ea0937 in term 1.
I20260811 01:34:13.359858 6315 raft_consensus.cc:2454] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a14e2b126648aea52178a4f7ea0937 in term 1.
I20260811 01:34:13.360303 6060 leader_election.cc:302] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba1a074b81434f9f90bd76496cd387ff, c5a14e2b126648aea52178a4f7ea0937; no voters:
I20260811 01:34:13.360618 6552 raft_consensus.cc:2781] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:13.361124 6552 raft_consensus.cc:686] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 1 LEADER]: Becoming Leader. State: Replica: c5a14e2b126648aea52178a4f7ea0937, State: Running, Role: LEADER
I20260811 01:34:13.361608 6552 consensus_queue.cc:237] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } }
I20260811 01:34:13.366462 5962 catalog_manager.cc:5495] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5a14e2b126648aea52178a4f7ea0937 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "c5a14e2b126648aea52178a4f7ea0937" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5a14e2b126648aea52178a4f7ea0937" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 45205 } health_report { overall_health: HEALTHY } } }
I20260811 01:34:13.417838 6542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.412110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33892 (local address 127.23.39.193:45205)
0811 01:34:13.412330 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.412338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.412475 (+ 137us) server_negotiation.cc:407] Connection header received
0811 01:34:13.412735 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.412740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.412819 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.412977 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:34:13.413373 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.414170 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.415621 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.416040 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.416184 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.416737 (+ 553us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:34:13.417236 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:34:13.417413 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.417473 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.417556 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:34:13.426864 6315 raft_consensus.cc:1261] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 1 FOLLOWER]: Refusing update from remote peer c5a14e2b126648aea52178a4f7ea0937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:13.426887 6465 raft_consensus.cc:1261] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 1 FOLLOWER]: Refusing update from remote peer c5a14e2b126648aea52178a4f7ea0937: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:13.427917 6552 consensus_queue.cc:1035] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba1a074b81434f9f90bd76496cd387ff" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:13.428328 6558 consensus_queue.cc:1035] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f3afdd22c784f5f9ec0210e4836c323" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 35713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:34:13.439474 6370 tablet.cc:2369] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:13.441251 6562 mvcc.cc:205] Tried to move back new op lower bound from 7317143770824269824 to 7317143770573647872. Current Snapshot: MvccSnapshot[applied={T|T < 7317143770824269824}]
I20260811 01:34:13.458252 5962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:13.458591 5962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:13.462738 5962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19d014c8f1464c548514683729756d83: Sending DeleteTablet for 3 replicas of tablet 0096bbbc75c546318a1bd678e14c922f
I20260811 01:34:13.464208 6291 tablet_service.cc:1514] Processing DeleteTablet for tablet 0096bbbc75c546318a1bd678e14c922f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:13 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:37964
I20260811 01:34:13.464351 6116 tablet_service.cc:1514] Processing DeleteTablet for tablet 0096bbbc75c546318a1bd678e14c922f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:13 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:33884
I20260811 01:34:13.465075 6441 tablet_service.cc:1514] Processing DeleteTablet for tablet 0096bbbc75c546318a1bd678e14c922f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:13 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 01:34:13.470728 6572 tablet_replica.cc:330] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: stopping tablet replica
I20260811 01:34:13.471264 6572 raft_consensus.cc:2229] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:13.471748 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6006
I20260811 01:34:13.471836 6572 raft_consensus.cc:2258] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:13.474709 6574 tablet_replica.cc:330] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: stopping tablet replica
I20260811 01:34:13.475225 6574 raft_consensus.cc:2229] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:13.475744 6574 raft_consensus.cc:2258] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:13.478029 6574 ts_tablet_manager.cc:1905] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:13.478029 6572 ts_tablet_manager.cc:1905] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:13.485519 6573 tablet_replica.cc:330] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: stopping tablet replica
I20260811 01:34:13.485773 6572 ts_tablet_manager.cc:1918] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:13.485625 6574 ts_tablet_manager.cc:1918] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:13.485984 6572 log.cc:1196] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/0096bbbc75c546318a1bd678e14c922f
I20260811 01:34:13.486048 6574 log.cc:1196] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/0096bbbc75c546318a1bd678e14c922f
I20260811 01:34:13.486303 6573 raft_consensus.cc:2229] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:34:13.486716 6572 ts_tablet_manager.cc:1939] T 0096bbbc75c546318a1bd678e14c922f P 7f3afdd22c784f5f9ec0210e4836c323: Deleting consensus metadata
I20260811 01:34:13.486853 6574 ts_tablet_manager.cc:1939] T 0096bbbc75c546318a1bd678e14c922f P ba1a074b81434f9f90bd76496cd387ff: Deleting consensus metadata
I20260811 01:34:13.487212 6573 raft_consensus.cc:2258] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:13.488794 5946 catalog_manager.cc:4841] TS 7f3afdd22c784f5f9ec0210e4836c323 (127.23.39.194:35713): tablet 0096bbbc75c546318a1bd678e14c922f (table test-table [id=f124720ec01a4c0d82dfbd86d9ffae15]) successfully deleted
I20260811 01:34:13.489711 5946 catalog_manager.cc:4841] TS ba1a074b81434f9f90bd76496cd387ff (127.23.39.195:45773): tablet 0096bbbc75c546318a1bd678e14c922f (table test-table [id=f124720ec01a4c0d82dfbd86d9ffae15]) successfully deleted
I20260811 01:34:13.490850 6573 ts_tablet_manager.cc:1905] T 0096bbbc75c546318a1bd678e14c922f P c5a14e2b126648aea52178a4f7ea0937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:13.492173 6542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.472776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33894 (local address 127.23.39.193:45205)
0811 01:34:13.473249 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.473255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.473275 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:34:13.473338 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.473344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.473421 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.473515 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.475820 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.477062 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.478960 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.479645 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.479779 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.483718 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.483736 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.483756 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.483810 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.488446 (+ 4636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.489486 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.489497 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.489503 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.489685 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.490293 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.490298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.490302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.490705 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.491078 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.491471 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.491727 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344}
I20260811 01:34:13.492897 6192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:13.591566 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6006
W20260811 01:34:13.613068 5945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:45205 (error 108)
I20260811 01:34:13.613343 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6201
I20260811 01:34:13.615080 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.614547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33906)
0811 01:34:13.614746 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.614875 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 01:34:13.615417 5945 catalog_manager.cc:4584] TS c5a14e2b126648aea52178a4f7ea0937 (127.23.39.193:45205): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0096bbbc75c546318a1bd678e14c922f: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
I20260811 01:34:13.627617 6539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.614224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37974 (local address 127.23.39.194:35713)
0811 01:34:13.614445 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.614451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.614473 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:34:13.614541 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.614547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.614632 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.614761 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.616320 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.617046 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.618336 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.618740 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.618845 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.621442 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.621457 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.621473 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.621513 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.624751 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.625456 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.625463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.625465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.625606 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.626004 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.626007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.626009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.626473 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.626719 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.627001 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.627175 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:34:13.628471 6361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:13.669337 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.668824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33914)
0811 01:34:13.669078 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.669189 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 01:34:13.670627 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.670220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33926)
0811 01:34:13.670382 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.670456 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 01:34:13.722934 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6201
I20260811 01:34:13.731251 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.730629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33942)
0811 01:34:13.730873 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.731000 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 01:34:13.732470 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.731948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33946)
0811 01:34:13.732162 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.732262 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:34:13.744084 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6369
I20260811 01:34:13.757930 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.744903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39956 (local address 127.23.39.195:45773)
0811 01:34:13.745096 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:13.745101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:13.745121 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:34:13.745314 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:13.745318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:13.745383 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:13.745469 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:13.746949 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.747655 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.748913 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:13.749297 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:13.749391 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:13.752131 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:13.752146 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:13.752162 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:13.752202 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:13.755201 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.755935 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.755941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.755944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.756092 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:13.756440 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:13.756446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:13.756449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:13.756832 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:13.757066 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:13.757358 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 01:34:13.757529 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:34:13.758745 6511 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:13.813089 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.812581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33954)
0811 01:34:13.812819 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.812924 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:34:13.814473 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.813950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33968)
0811 01:34:13.814225 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.814307 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 01:34:13.849987 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6369
I20260811 01:34:13.870399 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 5926
I20260811 01:34:13.871625 5999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:13.987891 6540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:13.987134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:45205 (local address 127.0.0.1:33978)
0811 01:34:13.987393 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:13.987510 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:45205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 01:34:13.988067 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 5926
I20260811 01:34:14.016355 23711 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 01:34:14.362525 23711 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 01:34:14.362725 23711 mini_ranger.cc:66] Stopping Ranger...
I20260811 01:34:14.709484 23711 mini_ranger.cc:68] Stopped Ranger
2026-08-11 01:34:14.709 UTC [4838] LOG: received smart shutdown request
2026-08-11 01:34:14.713 UTC [4838] LOG: background worker "logical replication launcher" (PID 4851) exited with exit code 1
2026-08-11 01:34:14.713 UTC [4842] LOG: shutting down
2026-08-11 01:34:14.901 UTC [4838] LOG: database system is shut down
2026-08-11T01:34:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55372 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:34:15 dist-test-slave-9jjr krb5kdc[6590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:34:15 dist-test-slave-9jjr krb5kdc[6590](info): set up 2 sockets
Aug 11 01:34:15 dist-test-slave-9jjr krb5kdc[6590](info): commencing operation
krb5kdc: starting...
W20260811 01:34:16.233347 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:34:16 dist-test-slave-9jjr krb5kdc[6590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:34:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:34:16.549912 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43593
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:16.918210 6604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:16.918550 6604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:16.918644 6604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:16.926049 6604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:16.926254 6604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:16.926311 6604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:16.926373 6604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:16.926417 6604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:16.936829 6604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:43593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:16.938227 6604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:16.939515 6604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:16.952095 6613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:16.952247 6609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:16.952292 6610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:16.953104 6604 server_base.cc:1034] running on GCE node
I20260811 01:34:16.953969 6604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:16.955525 6604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:16.956789 6604 hybrid_clock.cc:648] HybridClock initialized: now 1786412056956735 us; error 62 us; skew 500 ppm
I20260811 01:34:16.957176 6604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:16 dist-test-slave-9jjr krb5kdc[6590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:16.966042 6604 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:16.967815 6604 webserver.cc:460] Webserver started at http://127.23.39.254:44729/ using document root <none> and password file <none>
I20260811 01:34:16.968868 6604 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:16.968992 6604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:16.969280 6604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:16.972561 6604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "6e87a8c165fc46d9a0cb54eb7642de60"
format_stamp: "Formatted at 2026-08-11 01:34:16 on dist-test-slave-9jjr"
server_key: "421aedc15c8fc9af17bd3734187a940d"
server_key_iv: "a525a0cfce28e88622d1907eba9d68cb"
server_key_version: "encryptionkey@0"
I20260811 01:34:16.973434 6604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "6e87a8c165fc46d9a0cb54eb7642de60"
format_stamp: "Formatted at 2026-08-11 01:34:16 on dist-test-slave-9jjr"
server_key: "421aedc15c8fc9af17bd3734187a940d"
server_key_iv: "a525a0cfce28e88622d1907eba9d68cb"
server_key_version: "encryptionkey@0"
I20260811 01:34:16.979077 6604 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:34:16.983011 6620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:16.984503 6604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:34:16.984663 6604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "6e87a8c165fc46d9a0cb54eb7642de60"
format_stamp: "Formatted at 2026-08-11 01:34:16 on dist-test-slave-9jjr"
server_key: "421aedc15c8fc9af17bd3734187a940d"
server_key_iv: "a525a0cfce28e88622d1907eba9d68cb"
server_key_version: "encryptionkey@0"
I20260811 01:34:16.984853 6604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:17.010985 6604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:17.015692 6604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:17.015954 6604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:17.036814 6604 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:43593
I20260811 01:34:17.036832 6680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:43593 every 8 connection(s)
I20260811 01:34:17.038478 6604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:17.041811 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6604
I20260811 01:34:17.042055 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:34:17.042572 6681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:17.042841 23711 external_mini_cluster.cc:1428] Setting key 6830c7eb76a5e3853d971d1e3250be27
I20260811 01:34:17.049302 6681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:34:17 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.39.253@KRBTEST.COM; defaulting to no policy
I20260811 01:34:17.072688 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.052672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43593 (local address 127.0.0.1:51042)
0811 01:34:17.053669 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.053735 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:17.056108 (+ 2373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:17.056922 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:17.056929 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:17.057678 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:17.058009 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.058025 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.059665 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.059676 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.060750 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.060762 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.061682 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.061689 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.061859 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.062604 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:17.062628 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:17.065130 (+ 2502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:17.068496 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.068510 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.068523 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.068933 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.069365 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.069371 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.069375 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.069545 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.070389 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:17.070402 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:17.070625 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 01:34:17.070890 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 01:34:17.071656 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":255,"thread_start_us":446,"threads_started":1}
I20260811 01:34:17.072758 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.052672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.23.39.254:43593)
0811 01:34:17.054831 (+ 2159us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:17.054838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:17.054883 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:34:17.056442 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:17.056447 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:17.056686 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:17.056899 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:17.058269 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.059503 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.060890 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.061441 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.061645 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.065395 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:17.065403 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:17.065416 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:17.065444 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:17.068350 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.069084 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.069090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.069092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.069253 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.069651 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.069666 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.069675 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.070257 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:17.070471 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:17.071009 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 01:34:17.071486 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":1980,"spinlock_wait_cycles":24320,"thread_start_us":1659,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.253@KRBTEST.COM" created.
I20260811 01:34:17.075826 6681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:34:17.076898 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.076484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59052)
0811 01:34:17.076668 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.076777 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 01:34:17.077209 6623 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
I20260811 01:34:17.083796 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.083267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59066)
0811 01:34:17.083479 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.083595 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 01:34:17.084064 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:45251: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
I20260811 01:34:17.110540 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:45251
--webserver_interface=127.23.39.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:17.133550 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } attempt: 1
I20260811 01:34:17.134979 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.134450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59074)
0811 01:34:17.134708 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.134827 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 01:34:17.136086 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.135723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59084)
0811 01:34:17.135873 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.135950 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:34:17.136271 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:45251: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
I20260811 01:34:17.204531 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } attempt: 2
I20260811 01:34:17.205799 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.205250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59100)
0811 01:34:17.205532 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.205645 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 01:34:17.206916 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.206544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59114)
0811 01:34:17.206699 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.206789 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:34:17.207095 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:45251: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
I20260811 01:34:17.298355 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } attempt: 3
I20260811 01:34:17.299635 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.299112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59130)
0811 01:34:17.299333 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.299486 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 01:34:17.300735 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.300350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59140)
0811 01:34:17.300511 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.300597 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:34:17.300928 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:45251: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
I20260811 01:34:17.444209 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } attempt: 4
I20260811 01:34:17.445561 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.444967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59152)
0811 01:34:17.445324 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.445418 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174}
I20260811 01:34:17.446722 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.446327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59168)
0811 01:34:17.446502 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.446588 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:34:17.446918 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:45251: Network error: Client connection negotiation failed: client connection to 127.23.39.253:45251: connect: Connection refused (error 111)
W20260811 01:34:17.458755 6688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:17.459131 6688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:17.459298 6688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:17.467116 6688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:17.467301 6688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:17.467413 6688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:17.467522 6688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:17.467602 6688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:17.477998 6688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:45251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.39.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:17.479537 6688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:17.480888 6688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:17.493422 6695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:17.493445 6696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:17.493482 6698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:17.494386 6688 server_base.cc:1034] running on GCE node
I20260811 01:34:17.495213 6688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:17.496654 6688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:17.497906 6688 hybrid_clock.cc:648] HybridClock initialized: now 1786412057497852 us; error 64 us; skew 500 ppm
I20260811 01:34:17.498342 6688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:17 dist-test-slave-9jjr krb5kdc[6590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412057, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:17.501711 6688 init.cc:377] Logged in from keytab as kudu/127.23.39.253@KRBTEST.COM (short username kudu)
I20260811 01:34:17.503362 6688 webserver.cc:460] Webserver started at http://127.23.39.253:38229/ using document root <none> and password file <none>
I20260811 01:34:17.504110 6688 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:17.504278 6688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:17.504590 6688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:17.507782 6688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data/instance:
uuid: "791cdae1a253467ebdd228ced1967331"
format_stamp: "Formatted at 2026-08-11 01:34:17 on dist-test-slave-9jjr"
server_key: "3a3de3876f6608d0ce0d49dab6248112"
server_key_iv: "a6b44bd0d7003664ac62a34c0aa735d0"
server_key_version: "encryptionkey@0"
I20260811 01:34:17.508670 6688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal/instance:
uuid: "791cdae1a253467ebdd228ced1967331"
format_stamp: "Formatted at 2026-08-11 01:34:17 on dist-test-slave-9jjr"
server_key: "3a3de3876f6608d0ce0d49dab6248112"
server_key_iv: "a6b44bd0d7003664ac62a34c0aa735d0"
server_key_version: "encryptionkey@0"
I20260811 01:34:17.514384 6688 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260811 01:34:17.517999 6706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:17.519451 6688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:34:17.519651 6688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "791cdae1a253467ebdd228ced1967331"
format_stamp: "Formatted at 2026-08-11 01:34:17 on dist-test-slave-9jjr"
server_key: "3a3de3876f6608d0ce0d49dab6248112"
server_key_iv: "a6b44bd0d7003664ac62a34c0aa735d0"
server_key_version: "encryptionkey@0"
I20260811 01:34:17.519874 6688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:17.548003 6688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:17.552426 6688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:17.552736 6688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:17.572184 6688 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.253:45251
I20260811 01:34:17.572208 6764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.253:45251 every 8 connection(s)
I20260811 01:34:17.573647 6688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
I20260811 01:34:17.577549 6765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:17.581684 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6688
I20260811 01:34:17.581930 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-1/wal/instance
I20260811 01:34:17.582507 23711 external_mini_cluster.cc:1428] Setting key 1017c9ad454c22fae42763f09c0eab38
I20260811 01:34:17.586071 6765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:34:17 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412057, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:17.612571 6767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.589884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51058 (local address 127.23.39.254:43593)
0811 01:34:17.590445 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:17.590451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:17.591770 (+ 1319us) server_negotiation.cc:407] Connection header received
0811 01:34:17.594798 (+ 3028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:17.594803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:17.594928 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:17.595054 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:17.596662 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.597896 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.599563 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.600352 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.600503 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.604187 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:17.604196 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:17.604204 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:17.604268 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:17.608431 (+ 4163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.609411 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.609419 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.609425 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.609608 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.610168 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.610176 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.610183 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.610627 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:17.610800 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:17.611698 (+ 898us) server_negotiation.cc:299] Negotiation successful
0811 01:34:17.612039 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":284,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.252@KRBTEST.COM; defaulting to no policy
I20260811 01:34:17.613451 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.590654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43593 (local address 127.0.0.1:51058)
0811 01:34:17.591550 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.591603 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:17.594447 (+ 2844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:17.595282 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:17.595291 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:17.595860 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:17.596451 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.596468 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.598063 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.598067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.599393 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.599406 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.600584 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.600589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.600790 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.601559 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:17.601582 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:17.603920 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:17.608668 (+ 4748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.608678 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.608694 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.609234 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.609781 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.609785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.609787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.609997 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.610793 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:17.610800 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:17.611183 (+ 383us) client_negotiation.cc:769] Sending connection context
0811 01:34:17.611642 (+ 459us) client_negotiation.cc:240] Negotiation successful
0811 01:34:17.612112 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":344,"threads_started":1}
I20260811 01:34:17.615578 6765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.252@KRBTEST.COM" created.
Aug 11 01:34:17 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412057, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:34:17.632755 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.616302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59184)
0811 01:34:17.616499 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.616514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:17.616603 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:17.617560 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:17.617569 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:17.618108 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:17.618353 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.618368 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.619823 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.619831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.621305 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.621324 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.622322 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.622330 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.622578 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.623334 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:17.623363 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:17.626013 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:17.630005 (+ 3992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.630009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.630011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.630516 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.630919 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.630924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.630927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.631080 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.631701 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:17.631709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:17.631878 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 01:34:17.632018 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 01:34:17.632328 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 01:34:17.632871 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.616581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59184 (local address 127.23.39.253:45251)
0811 01:34:17.617141 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:17.617147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:17.617170 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:34:17.617212 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:17.617218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:17.617390 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:17.617501 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:17.618547 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.619668 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.621496 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.622060 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.622278 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.626337 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:17.626363 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:17.626382 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:17.626434 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:17.629865 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.630663 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.630677 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.630679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.630795 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.631187 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.631194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.631197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.631570 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:17.631807 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:17.632176 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 01:34:17.632451 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":424,"thread_start_us":295,"threads_started":1}
I20260811 01:34:17.635430 6765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:34:17.636799 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.636309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48162)
0811 01:34:17.636489 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.636629 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:34:17.637120 6708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.638832 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.638478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48170)
0811 01:34:17.638633 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.638721 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:34:17.639058 6765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
I20260811 01:34:17.654601 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:42041
--webserver_interface=127.23.39.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:17.688339 6765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 1
I20260811 01:34:17.689774 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.689162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48176)
0811 01:34:17.689455 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.689580 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 01:34:17.690862 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.690535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48190)
0811 01:34:17.690689 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.690762 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 01:34:17.691143 6765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.746218 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } attempt: 5
Aug 11 01:34:17 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:34:17.759356 6765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 2
I20260811 01:34:17.760473 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.759960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48194)
0811 01:34:17.760177 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.760288 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 01:34:17.761546 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.761141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48208)
0811 01:34:17.761288 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.761377 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 01:34:17.761837 6765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.762230 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.747186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59186 (local address 127.23.39.253:45251)
0811 01:34:17.747406 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:17.747410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:17.747517 (+ 107us) server_negotiation.cc:407] Connection header received
0811 01:34:17.747710 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:17.747714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:17.747776 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:17.747893 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:17.748871 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.749556 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.751370 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.751809 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.751902 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.755840 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:17.755846 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:17.755849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:17.755882 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:17.758730 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.759655 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.759662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.759667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.759814 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:17.760307 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:17.760312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:17.760315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:17.760979 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:17.761131 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:17.761622 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 01:34:17.761896 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:34:17.762404 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.747066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59186)
0811 01:34:17.747404 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.747427 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:17.747574 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:17.747952 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:17.747957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:17.748468 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:17.748712 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.748724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.749706 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.749714 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.751216 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:17.751241 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:17.751958 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:17.751964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:17.752191 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:17.752879 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:17.752904 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:17.755633 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:17.758902 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.758910 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.758916 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.759525 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.759943 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:17.759950 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:17.759959 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:17.760157 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:17.761119 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:17.761123 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:17.761334 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 01:34:17.761494 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 01:34:17.762003 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260811 01:34:17.763491 6681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:34:17.764592 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.764215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48224)
0811 01:34:17.764381 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.764464 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:34:17.765548 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.765243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48238)
0811 01:34:17.765374 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.765459 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 01:34:17.765743 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.817009 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 1
I20260811 01:34:17.818387 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.817764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48250)
0811 01:34:17.817992 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.818104 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 01:34:17.819471 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.819097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48258)
0811 01:34:17.819294 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.819362 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 01:34:17.819703 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.853096 6765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 3
I20260811 01:34:17.854630 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.853902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48266)
0811 01:34:17.854242 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.854382 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 01:34:17.856186 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.855593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48270)
0811 01:34:17.855878 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.856002 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260811 01:34:17.856521 6765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.887924 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 2
I20260811 01:34:17.889117 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.888598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48274)
0811 01:34:17.888856 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.888943 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:34:17.890228 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.889792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48286)
0811 01:34:17.889961 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.890054 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 01:34:17.890436 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.996685 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 3
I20260811 01:34:17.997853 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.997375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48292)
0811 01:34:17.997601 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.997689 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:34:17.998934 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:17.998507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48296)
0811 01:34:17.998747 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:17.998828 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260811 01:34:17.999148 6681 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
I20260811 01:34:17.999752 6765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 4
I20260811 01:34:18.000946 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.000369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48300)
0811 01:34:18.000632 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.000742 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 01:34:18.002097 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.001693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48308)
0811 01:34:18.001860 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.001950 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:34:18.002372 6765 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:42041: Network error: Client connection negotiation failed: client connection to 127.23.39.252:42041: connect: Connection refused (error 111)
W20260811 01:34:18.023274 6774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:18.023670 6774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:18.023780 6774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:18.031158 6774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:18.031287 6774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:18.031344 6774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:18.031401 6774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:18.031447 6774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:18.041594 6774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:43593,127.23.39.253:45251,127.23.39.252:42041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:42041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.39.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:18.042961 6774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:18.044365 6774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:18.056599 6779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:18.056512 6780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:18.056571 6782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:18.058015 6774 server_base.cc:1034] running on GCE node
I20260811 01:34:18.058956 6774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:18.060415 6774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:18.061631 6774 hybrid_clock.cc:648] HybridClock initialized: now 1786412058061561 us; error 62 us; skew 500 ppm
I20260811 01:34:18.061957 6774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412058, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:18.065402 6774 init.cc:377] Logged in from keytab as kudu/127.23.39.252@KRBTEST.COM (short username kudu)
I20260811 01:34:18.067047 6774 webserver.cc:460] Webserver started at http://127.23.39.252:38871/ using document root <none> and password file <none>
I20260811 01:34:18.067767 6774 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:18.067901 6774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:18.068215 6774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:18.071349 6774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data/instance:
uuid: "73a1112dd8ec4a60af02278459c9ff9c"
format_stamp: "Formatted at 2026-08-11 01:34:18 on dist-test-slave-9jjr"
server_key: "e1657b5aaf0a4908d5f8d5c4e068facf"
server_key_iv: "69cd0780f453aac5787be9056a9d7b47"
server_key_version: "encryptionkey@0"
I20260811 01:34:18.072199 6774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal/instance:
uuid: "73a1112dd8ec4a60af02278459c9ff9c"
format_stamp: "Formatted at 2026-08-11 01:34:18 on dist-test-slave-9jjr"
server_key: "e1657b5aaf0a4908d5f8d5c4e068facf"
server_key_iv: "69cd0780f453aac5787be9056a9d7b47"
server_key_version: "encryptionkey@0"
I20260811 01:34:18.077404 6774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:34:18.080881 6791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:18.082305 6774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:18.082490 6774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "73a1112dd8ec4a60af02278459c9ff9c"
format_stamp: "Formatted at 2026-08-11 01:34:18 on dist-test-slave-9jjr"
server_key: "e1657b5aaf0a4908d5f8d5c4e068facf"
server_key_iv: "69cd0780f453aac5787be9056a9d7b47"
server_key_version: "encryptionkey@0"
I20260811 01:34:18.082700 6774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:18.098083 6774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:18.102211 6774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:18.102505 6774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:18.122381 6774 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.252:42041
I20260811 01:34:18.122421 6849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.252:42041 every 8 connection(s)
I20260811 01:34:18.124279 6774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
I20260811 01:34:18.125844 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6774
I20260811 01:34:18.126060 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786411836859029-23711-0/minicluster-data/master-2/wal/instance
I20260811 01:34:18.126816 23711 external_mini_cluster.cc:1428] Setting key cb4f517085206322ffd2ffeeca42d0e5
I20260811 01:34:18.131424 6851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:18.138585 6851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412058, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:18.152120 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.129465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48316 (local address 127.23.39.252:42041)
0811 01:34:18.130347 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.130369 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.130437 (+ 68us) server_negotiation.cc:407] Connection header received
0811 01:34:18.132227 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.132255 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.132626 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.132996 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.134820 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.136209 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.137615 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.138385 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.138584 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.143571 (+ 4987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.143578 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.143588 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.143636 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.147130 (+ 3494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.147875 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.147886 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.147897 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.148130 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.148600 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.148604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.148606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.149446 (+ 840us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.149760 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.150208 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.150680 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":366,"threads_started":1}
I20260811 01:34:18.158728 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.141345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51064 (local address 127.23.39.254:43593)
0811 01:34:18.142039 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.142045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.142791 (+ 746us) server_negotiation.cc:407] Connection header received
0811 01:34:18.143011 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.143017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.143106 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.143245 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.144586 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.145766 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.147332 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.147746 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.147930 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.152011 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.152017 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.152020 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.152056 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.155408 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.156445 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.156454 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.156457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.156634 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.157027 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.157033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.157037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.157458 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.157618 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.158209 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.158399 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":556,"thread_start_us":327,"threads_started":1}
I20260811 01:34:18.158851 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.141307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:43593 (local address 127.0.0.1:51064)
0811 01:34:18.142641 (+ 1334us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.142679 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:18.142877 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:18.143302 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:18.143309 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:18.143995 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:18.144397 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.144413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.145954 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.145958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.147171 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.147184 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.148002 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.148009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.148208 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.148840 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:18.148923 (+ 83us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:18.151810 (+ 2887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:18.155627 (+ 3817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.155643 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.155649 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.156289 (+ 640us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.156759 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.156762 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.156765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.156894 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.157596 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:18.157602 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:18.157775 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 01:34:18.158014 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 01:34:18.158425 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1118,"spinlock_wait_cycles":20736,"thread_start_us":949,"threads_started":1}
I20260811 01:34:18.160383 6851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412058, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:34:18.173509 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.155254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51074 (local address 127.23.39.254:43593)
0811 01:34:18.155950 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.155956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.155980 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:34:18.156035 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.156043 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.156119 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.156228 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.157885 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.159273 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.161029 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.161664 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.161860 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.167039 (+ 5179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.167046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.167049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.167091 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.170486 (+ 3395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.171453 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.171460 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.171466 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.171633 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.172057 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.172064 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.172068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.172463 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.172758 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.173000 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.173176 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":307,"threads_started":1}
I20260811 01:34:18.175733 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.161105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:45251 (local address 127.0.0.1:59202)
0811 01:34:18.161339 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.161359 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:18.161456 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:18.161805 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:18.161813 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:18.162405 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:18.162621 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.162637 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.164179 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.164183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.165099 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.165113 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.165866 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.165872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.166081 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.166742 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:18.166759 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:18.168975 (+ 2216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:18.172853 (+ 3878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.172861 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.172868 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.173416 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.173926 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.173930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.173934 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.174178 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.174813 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:18.174820 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:18.174964 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 01:34:18.175108 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 01:34:18.175426 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 01:34:18.176266 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.161244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.23.39.253:45251)
0811 01:34:18.161412 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.161416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.161433 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:34:18.161555 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.161559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.161618 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.161728 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.162828 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.163963 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.165290 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.165704 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.165850 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.169184 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.169192 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.169198 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.169252 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.172673 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.173600 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.173607 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.173609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.173793 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.174289 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.174295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.174299 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.174565 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.174734 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.175263 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.175495 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:34:18.176369 6681 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 4
I20260811 01:34:18.179664 6851 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412058, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:34:18.193159 6683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.176989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48320)
0811 01:34:18.177188 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.177208 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:18.177321 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:18.177737 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:18.177740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:18.178086 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:18.178366 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.178381 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.179656 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.179663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.181005 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.181023 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.181914 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.181920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.182187 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.182897 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:18.182924 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:18.185791 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:18.190255 (+ 4464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.190259 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.190262 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.190642 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.191075 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.191080 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.191084 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.191308 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.192022 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:18.192028 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:18.192200 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 01:34:18.192372 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 01:34:18.192718 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:34:18.193230 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.177173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.23.39.252:42041)
0811 01:34:18.177384 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.177392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.177416 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:34:18.177481 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.177489 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.177593 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.177720 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.178537 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.179548 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.181212 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.181711 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.181888 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.185983 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.185990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.185996 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.186045 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.190060 (+ 4015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.190774 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.190781 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.190788 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.190949 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.191430 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.191435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.191438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.191879 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.192048 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.192528 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.192829 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":51}
I20260811 01:34:18.196753 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.180560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48322)
0811 01:34:18.180733 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.180753 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:18.180850 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:18.181820 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:18.181828 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:18.182366 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:18.182542 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.182551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.184159 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.184167 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.185365 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.185376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.186271 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.186279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.186574 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.187209 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:18.187232 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:18.189998 (+ 2766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:18.194057 (+ 4059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.194064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.194068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.194518 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.194912 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.194919 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.194923 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.195056 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.195691 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:18.195697 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:18.195851 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 01:34:18.196026 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 01:34:18.196375 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:34:18.197022 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.180746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48322 (local address 127.23.39.252:42041)
0811 01:34:18.181527 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.181532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.181553 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:34:18.181602 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.181607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.181664 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.181769 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.182714 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.184011 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.185492 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.186040 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.186210 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.190250 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.190258 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.190264 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.190303 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.193924 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.194641 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.194648 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.194653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.194820 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.195170 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.195175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.195178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.195550 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.195703 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.196191 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.196548 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":113,"server-negotiator.queue_time_us":653,"thread_start_us":401,"threads_started":1}
I20260811 01:34:18.198060 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.175453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.23.39.253:45251)
0811 01:34:18.176559 (+ 1106us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.176567 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.178453 (+ 1886us) server_negotiation.cc:407] Connection header received
0811 01:34:18.178627 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.178639 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.178745 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.180636 (+ 1891us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.180791 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.181911 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.183484 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.183881 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.184034 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.189770 (+ 5736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.189777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.189782 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.189824 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.194287 (+ 4463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.195475 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.195480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.195483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.195651 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.196136 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.196144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.196147 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.196546 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.196825 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.197462 (+ 637us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.197691 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":963,"thread_start_us":3267,"threads_started":1}
I20260811 01:34:18.199946 6681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: Bootstrap starting.
I20260811 01:34:18.203667 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:34:18.203661 6851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: Bootstrap starting.
I20260811 01:34:18.204084 6681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:18.205458 6681 log.cc:824] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:18.206836 6851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:18.208299 6851 log.cc:824] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:18.209227 6681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: No bootstrap required, opened a new log
I20260811 01:34:18.217561 6851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: No bootstrap required, opened a new log
I20260811 01:34:18.218770 6681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.219204 6681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:18.219337 6681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e87a8c165fc46d9a0cb54eb7642de60, State: Initialized, Role: FOLLOWER
I20260811 01:34:18.220112 6681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.227717 6868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.229375 6681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:18.232563 6868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.233106 6851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.233489 6851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:18.233641 6851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a1112dd8ec4a60af02278459c9ff9c, State: Initialized, Role: FOLLOWER
I20260811 01:34:18.234480 6851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.237340 6857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.210491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51086 (local address 127.23.39.254:43593)
0811 01:34:18.210702 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.210707 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.214895 (+ 4188us) server_negotiation.cc:407] Connection header received
0811 01:34:18.215241 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.215248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.215334 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.215418 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.217855 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.218912 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.221105 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.222051 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.222212 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.227648 (+ 5436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.227655 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.227659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.227706 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.231630 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.232560 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.232566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.232570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.234260 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.234881 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.234889 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.234896 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.235258 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.235490 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.236683 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.236976 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:34:18.249116 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.209960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.23.39.252:42041)
0811 01:34:18.210346 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.210353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.223816 (+ 13463us) server_negotiation.cc:407] Connection header received
0811 01:34:18.224102 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.224107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.224211 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.224286 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.231554 (+ 7268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.232708 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.234935 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.235614 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.235706 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.239598 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.239609 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.239618 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.239672 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.244626 (+ 4954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.245817 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.245826 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.245832 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.246029 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.246658 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.246666 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.246673 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.247173 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.247522 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.248270 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.248609 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260811 01:34:18.253890 6771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.224118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.23.39.253:45251)
0811 01:34:18.224326 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.224333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.229301 (+ 4968us) server_negotiation.cc:407] Connection header received
0811 01:34:18.229898 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.229905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.229982 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.230048 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.232735 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.233852 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.236540 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.237490 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.237617 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.244488 (+ 6871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.244500 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.244508 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.244567 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.249647 (+ 5080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.250763 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.250768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.250771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.250971 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.251566 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.251573 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.251579 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.252046 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.252359 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.252834 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.253171 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:34:18.254439 6870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.255038 6870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.255987 6851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:34:18.267428 6891 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:34:18.267580 6891 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 01:34:18.268934 6626 tablet.cc:2369] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:18.265296 6604 master_runner.cc:186] Error getting master registration for 127.23.39.253:45251: OK, instance_id { permanent_uuid: "791cdae1a253467ebdd228ced1967331" instance_seqno: 1786412057566612 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:34:18.279024 6604 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:34:18.280004 6899 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:34:18.280150 6899 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:34:18.286665 6870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:18.287103 6870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.291249 6870 leader_election.cc:288] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e87a8c165fc46d9a0cb54eb7642de60 (127.23.39.254:43593), 791cdae1a253467ebdd228ced1967331 (127.23.39.253:45251)
I20260811 01:34:18.291565 6652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73a1112dd8ec4a60af02278459c9ff9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" is_pre_election: true
I20260811 01:34:18.292248 6652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a1112dd8ec4a60af02278459c9ff9c in term 0.
I20260811 01:34:18.292959 6795 leader_election.cc:302] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e87a8c165fc46d9a0cb54eb7642de60, 73a1112dd8ec4a60af02278459c9ff9c; no voters:
I20260811 01:34:18.293550 6870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:34:18.293696 6870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:34:18.293798 6870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:18.282068 6774 master_runner.cc:186] Error getting master registration for 127.23.39.253:45251: OK, instance_id { permanent_uuid: "791cdae1a253467ebdd228ced1967331" instance_seqno: 1786412057566612 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:34:18.296104 6774 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:34:18.297391 6870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.298735 6652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73a1112dd8ec4a60af02278459c9ff9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e87a8c165fc46d9a0cb54eb7642de60"
I20260811 01:34:18.298852 6870 leader_election.cc:288] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [CANDIDATE]: Term 1 election: Requested vote from peers 6e87a8c165fc46d9a0cb54eb7642de60 (127.23.39.254:43593), 791cdae1a253467ebdd228ced1967331 (127.23.39.253:45251)
I20260811 01:34:18.298991 6652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:18.301604 6765 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } attempt: 5
I20260811 01:34:18.308202 6652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a1112dd8ec4a60af02278459c9ff9c in term 1.
I20260811 01:34:18.310864 6795 leader_election.cc:302] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e87a8c165fc46d9a0cb54eb7642de60, 73a1112dd8ec4a60af02278459c9ff9c; no voters:
I20260811 01:34:18.311451 6870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 01:34:18 dist-test-slave-9jjr krb5kdc[6590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412057, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:34:18.327112 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.302662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:42041 (local address 127.0.0.1:48346)
0811 01:34:18.303023 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:18.303045 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:18.303191 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:18.303747 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:18.303753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:18.304284 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:18.304499 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.304513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.306191 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.306196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.307677 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:18.307694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.309054 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.309061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:18.309285 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.310083 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:18.310107 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:18.313454 (+ 3347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:18.320023 (+ 6569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.320031 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.320036 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.321036 (+ 1000us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.323046 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:18.323052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:18.323056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:18.323385 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:18.324693 (+ 1308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:18.324699 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:18.325006 (+ 307us) client_negotiation.cc:769] Sending connection context
0811 01:34:18.325269 (+ 263us) client_negotiation.cc:240] Negotiation successful
0811 01:34:18.325798 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260811 01:34:18.328660 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:18.302350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.23.39.252:42041)
0811 01:34:18.302544 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:18.302550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:18.303303 (+ 753us) server_negotiation.cc:407] Connection header received
0811 01:34:18.303377 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:18.303382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:18.303460 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:18.303553 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:18.304656 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.305939 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.307959 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:18.308637 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:18.308779 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:18.313782 (+ 5003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:18.313790 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:18.313795 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:18.313837 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:18.319708 (+ 5871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.322413 (+ 2705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.322419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.322422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.322808 (+ 386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:18.323653 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:18.323664 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:18.323667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:18.324472 (+ 805us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:18.326420 (+ 1948us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:18.327047 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 01:34:18.327978 (+ 931us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:34:18.335143 6765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: Bootstrap starting.
I20260811 01:34:18.342104 6765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:18.344390 6765 log.cc:824] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:18.346515 6870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [term 1 LEADER]: Becoming Leader. State: Replica: 73a1112dd8ec4a60af02278459c9ff9c, State: Running, Role: LEADER
I20260811 01:34:18.347608 6870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.349252 6765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: No bootstrap required, opened a new log
W20260811 01:34:18.354647 6798 tablet.cc:2369] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:18.357792 6902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73a1112dd8ec4a60af02278459c9ff9c. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.359208 6902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:18.361343 6765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.361848 6765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:18.362027 6765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791cdae1a253467ebdd228ced1967331, State: Initialized, Role: FOLLOWER
I20260811 01:34:18.362879 6765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } }
I20260811 01:34:18.364058 6905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:18.366569 6905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:18.374311 6908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.376704 6737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73a1112dd8ec4a60af02278459c9ff9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791cdae1a253467ebdd228ced1967331"
I20260811 01:34:18.377146 6908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.377359 6737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:18.380892 6737 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a1112dd8ec4a60af02278459c9ff9c in term 1.
I20260811 01:34:18.376657 6738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73a1112dd8ec4a60af02278459c9ff9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "791cdae1a253467ebdd228ced1967331" is_pre_election: true
I20260811 01:34:18.381455 6738 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73a1112dd8ec4a60af02278459c9ff9c in term 1. Re-sending same reply.
I20260811 01:34:18.376631 6765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:18.383348 6738 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [term 1 FOLLOWER]: Refusing update from remote peer 73a1112dd8ec4a60af02278459c9ff9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:18.384691 6652 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [term 1 FOLLOWER]: Refusing update from remote peer 73a1112dd8ec4a60af02278459c9ff9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:18.389550 6902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:18.390321 6902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:18.423988 6868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73a1112dd8ec4a60af02278459c9ff9c. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.424350 6868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.426462 6908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73a1112dd8ec4a60af02278459c9ff9c. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.426792 6908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.428268 6909 mvcc.cc:205] Tried to move back new op lower bound from 7317143791123763200 to 7317143791000903680. Current Snapshot: MvccSnapshot[applied={T|T < 7317143791123763200}]
I20260811 01:34:18.431051 6868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.431329 6868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.434008 6870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.434415 6870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:18.434650 6870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.434911 6870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:18.442853 6905 catalog_manager.cc:1347] Generated new cluster ID: 3158d74c15ae4683960598487b75d19c
I20260811 01:34:18.442981 6905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:18.450847 6908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73a1112dd8ec4a60af02278459c9ff9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e87a8c165fc46d9a0cb54eb7642de60" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 43593 } } peers { permanent_uuid: "791cdae1a253467ebdd228ced1967331" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 45251 } } peers { permanent_uuid: "73a1112dd8ec4a60af02278459c9ff9c" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 42041 } } }
I20260811 01:34:18.451164 6908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:34:18.474939 6905 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:34:18.476936 6905 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:18.491683 6905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73a1112dd8ec4a60af02278459c9ff9c: Generated new TSK 0
I20260811 01:34:18.492815 6905 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:34:18.509289 6930 catalog_manager.cc:1259] Loaded cluster ID: 3158d74c15ae4683960598487b75d19c
I20260811 01:34:18.509415 6930 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: loading cluster ID for follower catalog manager: success
I20260811 01:34:18.524282 6930 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: acquiring CA information for follower catalog manager: success
I20260811 01:34:18.527583 6930 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 791cdae1a253467ebdd228ced1967331: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:34:19.269659 6891 catalog_manager.cc:1259] Loaded cluster ID: 3158d74c15ae4683960598487b75d19c
I20260811 01:34:19.269816 6891 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: loading cluster ID for follower catalog manager: success
I20260811 01:34:19.272439 6891 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: acquiring CA information for follower catalog manager: success
I20260811 01:34:19.274480 6891 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e87a8c165fc46d9a0cb54eb7642de60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:34:19.666185 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6604
I20260811 01:34:19.667451 6675 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:19.782826 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6604
I20260811 01:34:19.808068 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6688
I20260811 01:34:19.809198 6760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:19.920365 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6688
I20260811 01:34:19.944950 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6774
I20260811 01:34:19.946369 6844 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:20.058812 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6774
2026-08-11T01:34:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5024 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:34:20 dist-test-slave-9jjr krb5kdc[6944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:34:20 dist-test-slave-9jjr krb5kdc[6944](info): set up 2 sockets
Aug 11 01:34:20 dist-test-slave-9jjr krb5kdc[6944](info): commencing operation
krb5kdc: starting...
W20260811 01:34:21.267311 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:34:21 dist-test-slave-9jjr krb5kdc[6944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:34:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:34:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:34:21.572232 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45329
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:45329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:21.926940 6958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:21.927289 6958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:21.927487 6958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:21.935775 6958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:21.935901 6958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:21.936021 6958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:21.936210 6958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:21.936407 6958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:21.947687 6958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:45329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:45329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:21.949075 6958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:21.950553 6958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:21.963106 6963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:21.963166 6966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:21.963074 6964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:21.964450 6958 server_base.cc:1034] running on GCE node
I20260811 01:34:21.965252 6958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:21.966818 6958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:21.968039 6958 hybrid_clock.cc:648] HybridClock initialized: now 1786412061968000 us; error 32 us; skew 500 ppm
I20260811 01:34:21.968415 6958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:21 dist-test-slave-9jjr krb5kdc[6944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412061, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:21.976052 6958 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:21.977823 6958 webserver.cc:460] Webserver started at http://127.23.39.254:39309/ using document root <none> and password file <none>
I20260811 01:34:21.978638 6958 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:21.978780 6958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:21.979135 6958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:21.982398 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "4a5b8ed2bbc040fab927d6214ec792a3"
format_stamp: "Formatted at 2026-08-11 01:34:21 on dist-test-slave-9jjr"
server_key: "442d1f86e23206b1820f97dfd41f2fd4"
server_key_iv: "47025cdb951ceffece791a814008f5f0"
server_key_version: "encryptionkey@0"
I20260811 01:34:21.983212 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "4a5b8ed2bbc040fab927d6214ec792a3"
format_stamp: "Formatted at 2026-08-11 01:34:21 on dist-test-slave-9jjr"
server_key: "442d1f86e23206b1820f97dfd41f2fd4"
server_key_iv: "47025cdb951ceffece791a814008f5f0"
server_key_version: "encryptionkey@0"
I20260811 01:34:21.988436 6958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 01:34:21.991973 6975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:21.993283 6958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:34:21.993489 6958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "4a5b8ed2bbc040fab927d6214ec792a3"
format_stamp: "Formatted at 2026-08-11 01:34:21 on dist-test-slave-9jjr"
server_key: "442d1f86e23206b1820f97dfd41f2fd4"
server_key_iv: "47025cdb951ceffece791a814008f5f0"
server_key_version: "encryptionkey@0"
I20260811 01:34:21.993665 6958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:22.009147 6958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:22.013648 6958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:22.013968 6958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:22.032470 6958 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:45329
I20260811 01:34:22.032478 7030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:45329 every 8 connection(s)
I20260811 01:34:22.033942 6958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:22.039119 7032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:22.042420 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 6958
I20260811 01:34:22.042683 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:34:22.043442 23711 external_mini_cluster.cc:1428] Setting key 6e0735acc8182c9ba825bdf5fe3505fe
I20260811 01:34:22.052440 7032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3: Bootstrap starting.
I20260811 01:34:22.056700 7032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:22.058223 7032 log.cc:824] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:34:22 dist-test-slave-9jjr krb5kdc[6944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:22.061944 7032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3: No bootstrap required, opened a new log
I20260811 01:34:22.069379 7035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:22.045427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.23.39.254:45329)
0811 01:34:22.046332 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:22.046344 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:22.046387 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:34:22.048071 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:22.048095 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:22.048512 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:22.048838 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:22.050926 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:22.052266 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:22.054349 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:22.055063 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:22.055198 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:22.061088 (+ 5890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:22.061097 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:22.061113 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:22.061156 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:22.064744 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:22.065761 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:22.065768 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:22.065775 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:22.065980 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:22.066483 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:22.066487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:22.066489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:22.067104 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:22.067358 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:22.067826 (+ 468us) server_negotiation.cc:299] Negotiation successful
0811 01:34:22.068167 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":399,"threads_started":1}
I20260811 01:34:22.071650 7032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } }
I20260811 01:34:22.072124 7032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:22.072239 7032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5b8ed2bbc040fab927d6214ec792a3, State: Initialized, Role: FOLLOWER
I20260811 01:34:22.072933 7032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } }
I20260811 01:34:22.073212 7032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:22.073375 7032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:22.073570 7032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:22.073658 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:34:22.075981 7032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } }
I20260811 01:34:22.076545 7032 leader_election.cc:302] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a5b8ed2bbc040fab927d6214ec792a3; no voters:
I20260811 01:34:22.077231 7032 leader_election.cc:288] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:34:22.077368 7037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:22.078088 7037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [term 1 LEADER]: Becoming Leader. State: Replica: 4a5b8ed2bbc040fab927d6214ec792a3, State: Running, Role: LEADER
I20260811 01:34:22.078619 7037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } }
I20260811 01:34:22.079372 7032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:22.081719 7039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a5b8ed2bbc040fab927d6214ec792a3. Latest consensus state: current_term: 1 leader_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } } }
I20260811 01:34:22.082247 7039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:22.082082 7038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a5b8ed2bbc040fab927d6214ec792a3" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 45329 } } }
I20260811 01:34:22.082394 7038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3 [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:22.084014 7048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:22.088376 7048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:22.097117 7048 catalog_manager.cc:1347] Generated new cluster ID: 680a92c388c9466c8e40bdfea9e9441c
I20260811 01:34:22.097261 7048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:22.122709 7048 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:34:22.124902 7048 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:22.134781 7048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a5b8ed2bbc040fab927d6214ec792a3: Generated new TSK 0
I20260811 01:34:22.135897 7048 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:34:22.185829 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 6958
I20260811 01:34:22.187191 7026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:22.286597 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 6958
2026-08-11T01:34:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2224 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:34:22 dist-test-slave-9jjr krb5kdc[7062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:34:22 dist-test-slave-9jjr krb5kdc[7062](info): set up 2 sockets
Aug 11 01:34:22 dist-test-slave-9jjr krb5kdc[7062](info): commencing operation
krb5kdc: starting...
W20260811 01:34:23.552027 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:34:23 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:34:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:34:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:34:23.870574 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:24.227474 7075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:24.227793 7075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:24.227887 7075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:24.235693 7075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:24.235828 7075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:24.235877 7075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:24.235934 7075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:24.235973 7075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:24.246364 7075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:24.247712 7075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:24.249186 7075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:24.261808 7081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:24.261917 7083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:24.262276 7080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:24.263142 7075 server_base.cc:1034] running on GCE node
I20260811 01:34:24.264278 7075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:24.265867 7075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:24.267095 7075 hybrid_clock.cc:648] HybridClock initialized: now 1786412064267037 us; error 63 us; skew 500 ppm
I20260811 01:34:24.267547 7075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:24 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412064, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:24.271097 7075 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:24.272670 7075 webserver.cc:460] Webserver started at http://127.23.39.254:33825/ using document root <none> and password file <none>
I20260811 01:34:24.273480 7075 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:24.273634 7075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:24.273964 7075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:24.277238 7075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "cb4182c2c935485fb39565ab17885c2e"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "afea93e6dfd89aa6e520d74391b515df"
server_key_iv: "fd9acb0a02efc93375221fb1abe5d68e"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.278057 7075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "cb4182c2c935485fb39565ab17885c2e"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "afea93e6dfd89aa6e520d74391b515df"
server_key_iv: "fd9acb0a02efc93375221fb1abe5d68e"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.283754 7075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 01:34:24.287475 7090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:24.288888 7075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:34:24.289093 7075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "cb4182c2c935485fb39565ab17885c2e"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "afea93e6dfd89aa6e520d74391b515df"
server_key_iv: "fd9acb0a02efc93375221fb1abe5d68e"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.289287 7075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:24.326903 7075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:24.331463 7075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:24.331781 7075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:24.351119 7075 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42621
I20260811 01:34:24.351158 7148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42621 every 8 connection(s)
I20260811 01:34:24.352677 7075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:24.353168 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7075
I20260811 01:34:24.353420 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:34:24.354368 23711 external_mini_cluster.cc:1428] Setting key 85c0b9ccf5f2b08ccf0afd69bb9f3ff5
I20260811 01:34:24.357299 7149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:34:24 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:24.371369 7149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap starting.
I20260811 01:34:24.375073 7149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:24.376163 7149 log.cc:824] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:24.379253 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:24.356543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.23.39.254:42621)
0811 01:34:24.357479 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:24.357491 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:24.357535 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:34:24.359288 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:24.359310 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:24.359695 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:24.360046 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:24.361959 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:24.363496 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:24.365412 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:24.366116 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:24.366356 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:24.371446 (+ 5090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:24.371455 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:24.371472 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:24.371547 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:24.374858 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:24.375720 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:24.375728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:24.375734 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:24.375913 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:24.376338 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:24.376345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:24.376348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:24.377093 (+ 745us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:24.377451 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:24.377785 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 01:34:24.378226 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":383,"threads_started":1}
I20260811 01:34:24.379666 7149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: No bootstrap required, opened a new log
I20260811 01:34:24.387907 7149 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:24.388299 7149 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:24.388383 7149 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Initialized, Role: FOLLOWER
I20260811 01:34:24.388893 7149 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:24.389129 7149 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:24.389235 7149 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:24.389371 7149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:24.392005 7149 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:24.392529 7149 leader_election.cc:302] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4182c2c935485fb39565ab17885c2e; no voters:
I20260811 01:34:24.393203 7149 leader_election.cc:288] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:34:24.393428 7155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:24.394215 7155 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 LEADER]: Becoming Leader. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Running, Role: LEADER
I20260811 01:34:24.395171 7155 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:24.395680 7149 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:24.398407 7158 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4182c2c935485fb39565ab17885c2e. Latest consensus state: current_term: 1 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:24.398900 7158 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:24.402328 7156 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:24.402627 7156 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:24.403201 7164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:24.408663 7164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:24.418363 7164 catalog_manager.cc:1347] Generated new cluster ID: 54089a699cc84970b770a0bc061a1565
I20260811 01:34:24.418510 7164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:24.435570 7164 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:34:24.437649 7164 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:24.446375 7164 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Generated new TSK 0
I20260811 01:34:24.447472 7164 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:34:24.521854 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:24.887828 7178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:24.888145 7178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:24.888310 7178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:24.896193 7178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:24.896322 7178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:24.896533 7178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:24.907691 7178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:24.909139 7178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:24.910665 7178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:24.924425 7187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:24.924463 7185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:24.924425 7184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:24.925789 7178 server_base.cc:1034] running on GCE node
I20260811 01:34:24.926542 7178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:24.927522 7178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:24.928766 7178 hybrid_clock.cc:648] HybridClock initialized: now 1786412064928703 us; error 63 us; skew 500 ppm
I20260811 01:34:24.929102 7178 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:24 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412064, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:24.932483 7178 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:24.934046 7178 webserver.cc:460] Webserver started at http://127.23.39.193:44611/ using document root <none> and password file <none>
I20260811 01:34:24.934816 7178 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:24.934973 7178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:24.935299 7178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:24.938454 7178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "e386f8288f9e4846a77587b9fdc0a606"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "79d45f02b33b8c3cbd97a0cfb92902dd"
server_key_iv: "030e472eb45f4b2b4399b639c62a8cca"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.939288 7178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "e386f8288f9e4846a77587b9fdc0a606"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "79d45f02b33b8c3cbd97a0cfb92902dd"
server_key_iv: "030e472eb45f4b2b4399b639c62a8cca"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.944890 7178 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:34:24.948637 7194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:24.950244 7178 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 01:34:24.950438 7178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "e386f8288f9e4846a77587b9fdc0a606"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "79d45f02b33b8c3cbd97a0cfb92902dd"
server_key_iv: "030e472eb45f4b2b4399b639c62a8cca"
server_key_version: "encryptionkey@0"
I20260811 01:34:24.950670 7178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:24.971182 7178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:24.975716 7178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:24.976049 7178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:24.977121 7178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:24.978727 7178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:24.978837 7178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:24.979005 7178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:24.979079 7178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:25.014503 7178 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:46093
I20260811 01:34:25.014546 7318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:46093 every 8 connection(s)
I20260811 01:34:25.016049 7178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:25.025599 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7178
I20260811 01:34:25.025848 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:34:25.026646 23711 external_mini_cluster.cc:1428] Setting key 53fe75289911a61697bd8ae5930328f7
Aug 11 01:34:25 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412064, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:25.037976 7322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:25.018886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:57527 (local address 127.23.39.254:42621)
0811 01:34:25.019398 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:25.019403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:25.020187 (+ 784us) server_negotiation.cc:407] Connection header received
0811 01:34:25.022103 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:25.022109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:25.022236 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:25.022367 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:25.023997 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.024755 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.026604 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.027091 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.027241 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:25.031529 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:25.031534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:25.031538 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:25.031572 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:25.034464 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:25.035526 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:25.035530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:25.035532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:25.035658 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:25.036194 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:25.036197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:25.036199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:25.036456 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:25.036569 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:25.037524 (+ 955us) server_negotiation.cc:299] Negotiation successful
0811 01:34:25.037698 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":270,"threads_started":1}
I20260811 01:34:25.039675 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:25.019305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:57527)
0811 01:34:25.020022 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:25.020060 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:25.021799 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:25.022621 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:25.022630 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:25.023199 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:25.023804 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:25.023822 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.024928 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.024933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:25.026434 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:25.026448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.027357 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.027364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:25.027617 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:25.028343 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:25.028372 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:25.031274 (+ 2902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:25.034618 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:25.034632 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:25.034655 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:25.035391 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:25.035773 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:25.035780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:25.035787 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:25.036067 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:25.036588 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:25.036599 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:25.037092 (+ 493us) client_negotiation.cc:769] Sending connection context
0811 01:34:25.037450 (+ 358us) client_negotiation.cc:240] Negotiation successful
0811 01:34:25.038077 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":278,"threads_started":1}
I20260811 01:34:25.041427 7320 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:25.041759 7320 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:25.042635 7320 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:25.045089 7108 ts_manager.cc:194] Registered new tserver with Master: e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093)
I20260811 01:34:25.046739 7108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:57527
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:34:25.095837 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:25.447544 7326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:25.447908 7326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:25.448093 7326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:25.455727 7326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:25.455894 7326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:25.456074 7326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:25.466949 7326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:25.468842 7326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:25.470243 7326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:25.483358 7332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:25.483361 7333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:25.483359 7335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:25.484335 7326 server_base.cc:1034] running on GCE node
I20260811 01:34:25.484954 7326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:25.485949 7326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:25.487149 7326 hybrid_clock.cc:648] HybridClock initialized: now 1786412065487088 us; error 49 us; skew 500 ppm
I20260811 01:34:25.487476 7326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:25 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412065, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:25.490764 7326 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:25.492281 7326 webserver.cc:460] Webserver started at http://127.23.39.194:32867/ using document root <none> and password file <none>
I20260811 01:34:25.493043 7326 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:25.493192 7326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:25.493502 7326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:25.496721 7326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
format_stamp: "Formatted at 2026-08-11 01:34:25 on dist-test-slave-9jjr"
server_key: "42814a4c24a52888b239d96aba160c8b"
server_key_iv: "ea7781b022a819b1e4442351be684440"
server_key_version: "encryptionkey@0"
I20260811 01:34:25.497591 7326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
format_stamp: "Formatted at 2026-08-11 01:34:25 on dist-test-slave-9jjr"
server_key: "42814a4c24a52888b239d96aba160c8b"
server_key_iv: "ea7781b022a819b1e4442351be684440"
server_key_version: "encryptionkey@0"
I20260811 01:34:25.503000 7326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 01:34:25.506664 7342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:25.508093 7326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:34:25.508273 7326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
format_stamp: "Formatted at 2026-08-11 01:34:25 on dist-test-slave-9jjr"
server_key: "42814a4c24a52888b239d96aba160c8b"
server_key_iv: "ea7781b022a819b1e4442351be684440"
server_key_version: "encryptionkey@0"
I20260811 01:34:25.508486 7326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:25.525014 7326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:25.529587 7326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:25.529862 7326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:25.530905 7326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:25.532289 7326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:25.532389 7326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:25.532480 7326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:25.532524 7326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:25.566206 7326 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:46581
I20260811 01:34:25.566219 7465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:46581 every 8 connection(s)
I20260811 01:34:25.567576 7326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:25.576501 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7326
I20260811 01:34:25.576704 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:34:25.577154 23711 external_mini_cluster.cc:1428] Setting key 68ab60660e8f02a29813f340903c26a1
Aug 11 01:34:25 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412065, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:25.589882 7468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:25.570263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:44367 (local address 127.23.39.254:42621)
0811 01:34:25.570744 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:25.570750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:25.571739 (+ 989us) server_negotiation.cc:407] Connection header received
0811 01:34:25.573495 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:25.573499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:25.573570 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:25.573668 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:25.575209 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.575951 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.577633 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.578283 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.578387 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:25.582404 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:25.582413 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:25.582421 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:25.582470 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:25.586356 (+ 3886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:25.587185 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:25.587194 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:25.587200 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:25.587379 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:25.587827 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:25.587834 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:25.587839 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:25.588238 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:25.588397 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:25.589092 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 01:34:25.589359 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":240,"threads_started":1}
I20260811 01:34:25.590550 7469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:25.570860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:44367)
0811 01:34:25.571572 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:25.571609 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:25.573247 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:25.573875 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:25.573883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:25.574482 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:25.575053 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:25.575071 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.576084 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.576087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:25.577485 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:25.577498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:25.578521 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:25.578528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:25.578822 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:25.579617 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:25.579641 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:25.582090 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:25.586536 (+ 4446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:25.586549 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:25.586568 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:25.587038 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:25.587494 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:25.587497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:25.587500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:25.587704 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:25.588362 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:25.588367 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:25.588707 (+ 340us) client_negotiation.cc:769] Sending connection context
0811 01:34:25.588939 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 01:34:25.589370 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":266,"threads_started":1}
I20260811 01:34:25.592110 7466 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:25.592448 7466 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:25.593315 7466 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:25.594944 7108 ts_manager.cc:194] Registered new tserver with Master: 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581)
I20260811 01:34:25.596328 7108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:44367
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:34:25.649505 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:26.008031 7472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:26.008374 7472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:26.008549 7472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:26.017464 7472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:26.017619 7472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:26.017814 7472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:26.029006 7472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:26.030476 7472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:26.031776 7472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:26.045280 7479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:26.045322 7482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:26.045233 7480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:26.046234 7472 server_base.cc:1034] running on GCE node
I20260811 01:34:26.046931 7472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:26.047922 7472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:26.049161 7472 hybrid_clock.cc:648] HybridClock initialized: now 1786412066049096 us; error 57 us; skew 500 ppm
I20260811 01:34:26.049513 7472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:34:26.050824 7320 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
Aug 11 01:34:26 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412066, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:26.053392 7472 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:26.055173 7472 webserver.cc:460] Webserver started at http://127.23.39.195:32917/ using document root <none> and password file <none>
I20260811 01:34:26.055871 7472 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:26.055981 7472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:26.056233 7472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:26.059341 7472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "b04fc2c167014e449983290ecefcae01"
format_stamp: "Formatted at 2026-08-11 01:34:26 on dist-test-slave-9jjr"
server_key: "3839a065e296f423d9aa3dfff2f4a9eb"
server_key_iv: "e003e602eb186f617d1a40959d872106"
server_key_version: "encryptionkey@0"
I20260811 01:34:26.060104 7472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "b04fc2c167014e449983290ecefcae01"
format_stamp: "Formatted at 2026-08-11 01:34:26 on dist-test-slave-9jjr"
server_key: "3839a065e296f423d9aa3dfff2f4a9eb"
server_key_iv: "e003e602eb186f617d1a40959d872106"
server_key_version: "encryptionkey@0"
I20260811 01:34:26.065374 7472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260811 01:34:26.068858 7490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:26.070367 7472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:26.070549 7472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "b04fc2c167014e449983290ecefcae01"
format_stamp: "Formatted at 2026-08-11 01:34:26 on dist-test-slave-9jjr"
server_key: "3839a065e296f423d9aa3dfff2f4a9eb"
server_key_iv: "e003e602eb186f617d1a40959d872106"
server_key_version: "encryptionkey@0"
I20260811 01:34:26.070766 7472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:26.087984 7472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:26.092527 7472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:26.092873 7472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:26.093950 7472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:26.095438 7472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:26.095515 7472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:26.095664 7472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:26.095717 7472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:26.131402 7472 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46419
I20260811 01:34:26.131440 7610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46419 every 8 connection(s)
I20260811 01:34:26.132833 7472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:26.137480 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7472
I20260811 01:34:26.137707 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:34:26.138262 23711 external_mini_cluster.cc:1428] Setting key 12138a4fc8bcde09f38017d5d8de83c1
Aug 11 01:34:26 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412066, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:26.153884 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.135747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:37593 (local address 127.23.39.254:42621)
0811 01:34:26.136251 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.136256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.137041 (+ 785us) server_negotiation.cc:407] Connection header received
0811 01:34:26.139206 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.139210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.139306 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.139399 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:26.141424 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.142292 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.143845 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.144253 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.144391 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.147842 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:26.147846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:26.147850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:26.147884 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:26.150691 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.151342 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.151346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.151348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.151473 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.151907 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.151915 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.151918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.152199 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:26.152400 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.153185 (+ 785us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.153425 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":260,"threads_started":1}
I20260811 01:34:26.155267 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.136143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:37593)
0811 01:34:26.136869 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.136907 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.138882 (+ 1975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.139694 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.139703 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.140411 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:26.141235 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.141263 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.142442 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.142448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.143700 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.143712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.144487 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.144497 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.144748 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.145365 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:26.145392 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:26.147638 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:26.150817 (+ 3179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:26.150824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:26.150836 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:26.151242 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:26.151574 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:26.151577 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:26.151579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:26.151783 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:26.152370 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:26.152378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:26.152826 (+ 448us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.153103 (+ 277us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.153666 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":288,"threads_started":1}
I20260811 01:34:26.157397 7611 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:26.157788 7611 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:26.158623 7611 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:26.160130 7108 ts_manager.cc:194] Registered new tserver with Master: b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:26.161000 7108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:37593
I20260811 01:34:26.166489 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:34:26.183905 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.171126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52122 (local address 127.23.39.254:42621)
0811 01:34:26.171329 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.171333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.171837 (+ 504us) server_negotiation.cc:407] Connection header received
0811 01:34:26.171978 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.171982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.172043 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.172128 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:26.173525 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.174385 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.175893 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.176333 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.176427 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.178824 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:26.178829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:26.178832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:26.178866 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:26.181508 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.182172 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.182180 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.182185 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.182338 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.182686 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.182689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.182691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.183008 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:26.183214 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.183509 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.183680 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:34:26.188297 7108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:34:26.195399 7108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:34:26.224629 7626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.208303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55980)
0811 01:34:26.209168 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.209229 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.209442 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.210901 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.210908 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.210940 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:26.211374 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.211388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.216054 (+ 4666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.216062 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.219443 (+ 3381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.219470 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.223471 (+ 4001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.223480 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.223702 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.223777 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.223901 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.224138 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":338,"threads_started":1}
I20260811 01:34:26.226082 7627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.208603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55980 (local address 127.23.39.193:46093)
0811 01:34:26.210230 (+ 1627us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.210241 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.210275 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:34:26.210384 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.210391 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.210654 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.211597 (+ 943us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:26.212100 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.215856 (+ 3756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.221236 (+ 5380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.223223 (+ 1987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.225340 (+ 2117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.225615 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.225692 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.225841 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1412,"thread_start_us":1233,"threads_started":1}
I20260811 01:34:26.230388 7246 tablet_service.cc:1467] Processing CreateTablet for tablet d9d3cef24b42440bb426eeee73ab3308 (DEFAULT_TABLE table=test-table [id=c81390cb32664ee591717ee69bddf4d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:26.232046 7246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9d3cef24b42440bb426eeee73ab3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:26.232336 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.209645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51538 (local address 127.23.39.194:46581)
0811 01:34:26.223408 (+ 13763us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.223420 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.223455 (+ 35us) server_negotiation.cc:407] Connection header received
0811 01:34:26.223572 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.223580 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.223876 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.224120 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:26.225465 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.227007 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.229697 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.231184 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.231329 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.231522 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.231823 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.231984 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13566,"thread_start_us":13421,"threads_started":1}
I20260811 01:34:26.232376 7628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.209372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46581 (local address 127.0.0.1:51538)
0811 01:34:26.210462 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.210478 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.210587 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.224160 (+ 13573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.224170 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.224214 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:26.225144 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.225164 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.227154 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.227161 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.229441 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.229458 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.231424 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.231431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.231616 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.231653 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.231764 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.231909 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":1366,"threads_started":1}
I20260811 01:34:26.233414 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.209717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46419 (local address 127.0.0.1:57696)
0811 01:34:26.222442 (+ 12725us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.222464 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.222591 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.226582 (+ 3991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.226587 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.226616 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:26.226987 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.227002 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.228480 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.228485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.230553 (+ 2068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.230566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.232571 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.232577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.232767 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.232809 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.232900 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.233036 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12583,"mutex_wait_us":1,"thread_start_us":12968,"threads_started":1}
I20260811 01:34:26.233577 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.210453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.23.39.195:46419)
0811 01:34:26.225699 (+ 15246us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.225707 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.225743 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:34:26.225849 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.225857 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.226117 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.226341 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:26.227214 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.228308 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.230752 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.232074 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.232199 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.232440 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.233048 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.233219 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15035,"thread_start_us":15820,"threads_started":1}
I20260811 01:34:26.236658 7396 tablet_service.cc:1467] Processing CreateTablet for tablet d9d3cef24b42440bb426eeee73ab3308 (DEFAULT_TABLE table=test-table [id=c81390cb32664ee591717ee69bddf4d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:26.237115 7544 tablet_service.cc:1467] Processing CreateTablet for tablet d9d3cef24b42440bb426eeee73ab3308 (DEFAULT_TABLE table=test-table [id=c81390cb32664ee591717ee69bddf4d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:26.237929 7396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9d3cef24b42440bb426eeee73ab3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:26.238498 7544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9d3cef24b42440bb426eeee73ab3308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:26.249512 7633 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Bootstrap starting.
I20260811 01:34:26.250499 7632 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Bootstrap starting.
I20260811 01:34:26.253573 7633 tablet_bootstrap.cc:654] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:26.254000 7632 tablet_bootstrap.cc:654] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:26.254825 7634 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Bootstrap starting.
I20260811 01:34:26.255131 7633 log.cc:824] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:26.255224 7632 log.cc:824] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:26.258085 7633 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: No bootstrap required, opened a new log
I20260811 01:34:26.258414 7633 ts_tablet_manager.cc:1397] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260811 01:34:26.258605 7632 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: No bootstrap required, opened a new log
I20260811 01:34:26.258798 7634 tablet_bootstrap.cc:654] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:26.258882 7632 ts_tablet_manager.cc:1397] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260811 01:34:26.260087 7634 log.cc:824] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:26.263474 7634 tablet_bootstrap.cc:492] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: No bootstrap required, opened a new log
I20260811 01:34:26.263757 7634 ts_tablet_manager.cc:1397] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:34:26.267035 7633 raft_consensus.cc:348] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.267448 7633 raft_consensus.cc:374] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:26.267563 7633 raft_consensus.cc:729] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2ec7788b654ab49a78bfa02c68aa7b, State: Initialized, Role: FOLLOWER
I20260811 01:34:26.268328 7633 consensus_queue.cc:260] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.269663 7466 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
I20260811 01:34:26.269548 7632 raft_consensus.cc:348] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.269969 7632 raft_consensus.cc:374] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:26.270051 7632 raft_consensus.cc:729] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e386f8288f9e4846a77587b9fdc0a606, State: Initialized, Role: FOLLOWER
I20260811 01:34:26.270364 7633 ts_tablet_manager.cc:1428] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260811 01:34:26.270664 7632 consensus_queue.cc:260] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.274946 7632 ts_tablet_manager.cc:1428] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Time spent starting tablet: real 0.016s user 0.010s sys 0.006s
I20260811 01:34:26.275712 7634 raft_consensus.cc:348] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.277340 7634 raft_consensus.cc:374] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:26.277453 7634 raft_consensus.cc:729] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04fc2c167014e449983290ecefcae01, State: Initialized, Role: FOLLOWER
I20260811 01:34:26.278113 7634 consensus_queue.cc:260] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.279526 7611 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
I20260811 01:34:26.280061 7634 ts_tablet_manager.cc:1428] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Time spent starting tablet: real 0.016s user 0.004s sys 0.011s
I20260811 01:34:26.302093 7639 raft_consensus.cc:482] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:26.302542 7639 raft_consensus.cc:504] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.304308 7639 leader_election.cc:288] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:26.311409 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.304822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:54841 (local address 127.23.39.195:46419)
0811 01:34:26.305082 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.305088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.305982 (+ 894us) server_negotiation.cc:407] Connection header received
0811 01:34:26.306215 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.306218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.306283 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.306386 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:26.306923 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.307715 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.309585 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.310450 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.310652 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.310729 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.311020 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.311153 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:34:26.311455 7642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.304612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46581 (local address 127.23.39.193:45767)
0811 01:34:26.305316 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.305337 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.305526 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.305897 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.305902 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.305937 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:26.306371 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.306381 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.307518 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.307525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.309263 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.309275 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.310515 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.310521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.310708 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.310733 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.310847 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.310983 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":113,"spinlock_wait_cycles":34560,"thread_start_us":342,"threads_started":1}
I20260811 01:34:26.311894 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.304930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:45767 (local address 127.23.39.194:46581)
0811 01:34:26.305161 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.305168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.305442 (+ 274us) server_negotiation.cc:407] Connection header received
0811 01:34:26.305688 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.305694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.305764 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.305868 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:26.306563 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.307382 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.309433 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.310307 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.310493 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.310584 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.310887 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.311020 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:34:26.311669 7643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.304614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46419 (local address 127.23.39.193:54841)
0811 01:34:26.305856 (+ 1242us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:26.305870 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:26.306032 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:26.306401 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:26.306405 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:26.306428 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:26.306766 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.306774 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.307870 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.307877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.309405 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:26.309418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.310677 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.310683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:26.310860 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.310883 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:34:26.310992 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 01:34:26.311127 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":491,"thread_start_us":370,"threads_started":1}
I20260811 01:34:26.313409 7416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9d3cef24b42440bb426eeee73ab3308" candidate_uuid: "e386f8288f9e4846a77587b9fdc0a606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" is_pre_election: true
I20260811 01:34:26.313411 7564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9d3cef24b42440bb426eeee73ab3308" candidate_uuid: "e386f8288f9e4846a77587b9fdc0a606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04fc2c167014e449983290ecefcae01" is_pre_election: true
I20260811 01:34:26.313927 7564 raft_consensus.cc:2454] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e386f8288f9e4846a77587b9fdc0a606 in term 0.
I20260811 01:34:26.313925 7416 raft_consensus.cc:2454] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e386f8288f9e4846a77587b9fdc0a606 in term 0.
I20260811 01:34:26.314642 7197 leader_election.cc:302] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04fc2c167014e449983290ecefcae01, e386f8288f9e4846a77587b9fdc0a606; no voters:
I20260811 01:34:26.315081 7639 raft_consensus.cc:2781] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:34:26.315249 7639 raft_consensus.cc:482] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:34:26.315400 7639 raft_consensus.cc:3037] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:26.317718 7639 raft_consensus.cc:504] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.318498 7639 leader_election.cc:288] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 1 election: Requested vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:26.318885 7416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9d3cef24b42440bb426eeee73ab3308" candidate_uuid: "e386f8288f9e4846a77587b9fdc0a606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
I20260811 01:34:26.319110 7416 raft_consensus.cc:3037] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:26.319044 7564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9d3cef24b42440bb426eeee73ab3308" candidate_uuid: "e386f8288f9e4846a77587b9fdc0a606" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04fc2c167014e449983290ecefcae01"
I20260811 01:34:26.319331 7564 raft_consensus.cc:3037] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:34:26.319945 7467 tablet.cc:2369] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:26.321681 7564 raft_consensus.cc:2454] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e386f8288f9e4846a77587b9fdc0a606 in term 1.
I20260811 01:34:26.322146 7197 leader_election.cc:302] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04fc2c167014e449983290ecefcae01, e386f8288f9e4846a77587b9fdc0a606; no voters:
I20260811 01:34:26.322316 7416 raft_consensus.cc:2454] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e386f8288f9e4846a77587b9fdc0a606 in term 1.
I20260811 01:34:26.322465 7639 raft_consensus.cc:2781] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:26.322983 7639 raft_consensus.cc:686] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 1 LEADER]: Becoming Leader. State: Replica: e386f8288f9e4846a77587b9fdc0a606, State: Running, Role: LEADER
I20260811 01:34:26.323720 7639 consensus_queue.cc:237] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:26.328190 7107 catalog_manager.cc:5495] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 reported cstate change: term changed from 0 to 1, leader changed from <none> to e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "e386f8288f9e4846a77587b9fdc0a606" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } health_report { overall_health: UNKNOWN } } }
I20260811 01:34:26.348676 7627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.343628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55994 (local address 127.23.39.193:46093)
0811 01:34:26.343819 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.343823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.343841 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:34:26.343923 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.343926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.344007 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.344138 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:34:26.344483 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.345196 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.346737 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.347138 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.347235 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.347709 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:34:26.348200 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:34:26.348308 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.348401 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.348466 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 01:34:26.357148 7416 raft_consensus.cc:1261] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Refusing update from remote peer e386f8288f9e4846a77587b9fdc0a606: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:26.357270 7564 raft_consensus.cc:1261] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Refusing update from remote peer e386f8288f9e4846a77587b9fdc0a606: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:26.358191 7644 consensus_queue.cc:1035] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:26.358659 7639 consensus_queue.cc:1035] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:26.380465 7651 mvcc.cc:205] Tried to move back new op lower bound from 7317143823788425216 to 7317143823665659904. Current Snapshot: MvccSnapshot[applied={T|T < 7317143823788425216}]
I20260811 01:34:26.401974 7107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:26.402344 7107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:26.406167 7107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Sending DeleteTablet for 3 replicas of tablet d9d3cef24b42440bb426eeee73ab3308
I20260811 01:34:26.407372 7246 tablet_service.cc:1514] Processing DeleteTablet for tablet d9d3cef24b42440bb426eeee73ab3308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:26 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:55980
I20260811 01:34:26.407465 7544 tablet_service.cc:1514] Processing DeleteTablet for tablet d9d3cef24b42440bb426eeee73ab3308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:26 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:57696
I20260811 01:34:26.408298 7396 tablet_service.cc:1514] Processing DeleteTablet for tablet d9d3cef24b42440bb426eeee73ab3308 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:26 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:51538
I20260811 01:34:26.408432 7659 tablet_replica.cc:330] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: stopping tablet replica
I20260811 01:34:26.408891 7659 raft_consensus.cc:2229] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:34:26.409374 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7178
I20260811 01:34:26.409593 7659 raft_consensus.cc:2258] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:26.418118 7659 ts_tablet_manager.cc:1905] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:26.426322 7662 tablet_replica.cc:330] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: stopping tablet replica
I20260811 01:34:26.426867 7662 raft_consensus.cc:2229] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:26.427430 7662 raft_consensus.cc:2258] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:26.432231 7662 ts_tablet_manager.cc:1905] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:26.433476 7659 ts_tablet_manager.cc:1918] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:26.433712 7659 log.cc:1196] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/d9d3cef24b42440bb426eeee73ab3308
I20260811 01:34:26.434369 7659 ts_tablet_manager.cc:1939] T d9d3cef24b42440bb426eeee73ab3308 P e386f8288f9e4846a77587b9fdc0a606: Deleting consensus metadata
Aug 11 01:34:26 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:34:26.436548 7091 catalog_manager.cc:4841] TS e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093): tablet d9d3cef24b42440bb426eeee73ab3308 (table test-table [id=c81390cb32664ee591717ee69bddf4d1]) successfully deleted
I20260811 01:34:26.436829 7661 tablet_replica.cc:330] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: stopping tablet replica
I20260811 01:34:26.437301 7661 raft_consensus.cc:2229] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:26.437901 7661 raft_consensus.cc:2258] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:26.440454 7661 ts_tablet_manager.cc:1905] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:26.441361 7662 ts_tablet_manager.cc:1918] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:26.441524 7662 log.cc:1196] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/d9d3cef24b42440bb426eeee73ab3308
I20260811 01:34:26.442077 7662 ts_tablet_manager.cc:1939] T d9d3cef24b42440bb426eeee73ab3308 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting consensus metadata
I20260811 01:34:26.444043 7091 catalog_manager.cc:4841] TS 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): tablet d9d3cef24b42440bb426eeee73ab3308 (table test-table [id=c81390cb32664ee591717ee69bddf4d1]) successfully deleted
I20260811 01:34:26.446950 7627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.410925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55636 (local address 127.23.39.193:46093)
0811 01:34:26.411159 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.411168 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.422954 (+ 11786us) server_negotiation.cc:407] Connection header received
0811 01:34:26.423167 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.423175 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.423297 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.423454 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:26.426293 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.427453 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.429582 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.430339 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.430445 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.437739 (+ 7294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:26.437753 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:26.437772 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:26.437829 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:26.442777 (+ 4948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.443944 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.443954 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.443957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.444165 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.444784 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.444791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.444795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.445312 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:26.445603 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.446253 (+ 650us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.446513 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:34:26.447844 7661 ts_tablet_manager.cc:1918] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:26.448024 7661 log.cc:1196] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/d9d3cef24b42440bb426eeee73ab3308
I20260811 01:34:26.448629 7661 ts_tablet_manager.cc:1939] T d9d3cef24b42440bb426eeee73ab3308 P b04fc2c167014e449983290ecefcae01: Deleting consensus metadata
I20260811 01:34:26.448824 7314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:26.450945 7093 catalog_manager.cc:4841] TS b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): tablet d9d3cef24b42440bb426eeee73ab3308 (table test-table [id=c81390cb32664ee591717ee69bddf4d1]) successfully deleted
I20260811 01:34:26.550940 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7178
I20260811 01:34:26.576411 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7326
Aug 11 01:34:26 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:34:26.594170 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.577169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.23.39.194:46581)
0811 01:34:26.577357 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.577363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.577383 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:34:26.577560 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.577566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.577666 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.577771 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:26.579155 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.580290 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.581577 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.582332 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.582448 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.586906 (+ 4458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:26.586918 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:26.586934 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:26.586985 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:26.591048 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.591780 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.591789 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.591793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.591954 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.592364 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.592369 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.592372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.592862 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:26.593161 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.593592 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.593821 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:34:26.594832 7461 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:26.690233 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7326
I20260811 01:34:26.710736 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7472
Aug 11 01:34:26 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:34:26.727139 7631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:26.711619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40662 (local address 127.23.39.195:46419)
0811 01:34:26.711826 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:26.711834 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:26.711857 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:34:26.712079 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:26.712084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:26.712158 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:26.712307 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:26.713784 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.714637 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.716135 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:26.716555 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:26.716704 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:26.721422 (+ 4718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:26.721440 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:26.721456 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:26.721500 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:26.724254 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.725129 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.725136 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.725139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.725364 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:26.725762 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:26.725766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:26.725768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:26.726196 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:26.726446 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:26.726717 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 01:34:26.726895 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:34:26.727890 7606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:26.820004 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7472
I20260811 01:34:26.841961 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7075
I20260811 01:34:26.843199 7144 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:26.957679 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7075
I20260811 01:34:26.983794 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--webserver_interface=127.23.39.254
--webserver_port=33825
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:27.329841 7669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:27.330243 7669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:27.330415 7669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:27.338454 7669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:27.338624 7669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:27.338749 7669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:27.338853 7669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:27.338936 7669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:27.349661 7669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=33825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:27.351127 7669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:27.352502 7669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:27.380971 7677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:27.380918 7681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:27.380939 7678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:27.381903 7669 server_base.cc:1034] running on GCE node
I20260811 01:34:27.382911 7669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:27.384581 7669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:27.385830 7669 hybrid_clock.cc:648] HybridClock initialized: now 1786412067385760 us; error 50 us; skew 500 ppm
I20260811 01:34:27.386322 7669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:27 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412067, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:27.394263 7669 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:27.396109 7669 webserver.cc:460] Webserver started at http://127.23.39.254:33825/ using document root <none> and password file <none>
I20260811 01:34:27.396869 7669 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:27.396994 7669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:27.403353 7669 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:34:27.406397 7689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:27.407797 7669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:34:27.407989 7669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "cb4182c2c935485fb39565ab17885c2e"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "afea93e6dfd89aa6e520d74391b515df"
server_key_iv: "fd9acb0a02efc93375221fb1abe5d68e"
server_key_version: "encryptionkey@0"
I20260811 01:34:27.409106 7669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:27.435568 7669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:27.440699 7669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:27.441028 7669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:27.461422 7669 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42621
I20260811 01:34:27.461448 7747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42621 every 8 connection(s)
I20260811 01:34:27.463268 7669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:27.470669 7748 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:34:27.473420 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7669
I20260811 01:34:27.474231 7748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap starting.
I20260811 01:34:27.474331 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:46093
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=44611
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:27.494521 7748 log.cc:824] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:27.506800 7748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:34:27.507391 7748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap complete.
I20260811 01:34:27.517058 7748 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:27.517952 7748 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Initialized, Role: FOLLOWER
I20260811 01:34:27.518605 7748 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:27.518872 7748 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:27.519009 7748 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:27.519209 7748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:34:27.523195 7748 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:27.523743 7748 leader_election.cc:302] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4182c2c935485fb39565ab17885c2e; no voters:
I20260811 01:34:27.524437 7748 leader_election.cc:288] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:34:27.524583 7753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:34:27.525931 7753 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 LEADER]: Becoming Leader. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Running, Role: LEADER
I20260811 01:34:27.526540 7753 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:27.526897 7748 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:27.529410 7754 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:27.529889 7754 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:27.533783 7755 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4182c2c935485fb39565ab17885c2e. Latest consensus state: current_term: 2 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:27.534166 7755 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:27.535974 7759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:27.544795 7759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:27.546275 7759 catalog_manager.cc:1259] Loaded cluster ID: 54089a699cc84970b770a0bc061a1565
I20260811 01:34:27.546376 7759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:27.549605 7759 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 01:34:27.568003 7759 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 01:34:27.589442 7759 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:27.595854 7759 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Loaded TSK: 0
I20260811 01:34:27.598268 7759 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:34:27.871938 7750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:27.872305 7750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:27.872480 7750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:27.880175 7750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:27.880357 7750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:27.880535 7750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:27.892695 7750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:46093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=44611
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:27.894186 7750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:27.895555 7750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:27.910004 7779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:27.909945 7780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:27.910228 7782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:27.910719 7750 server_base.cc:1034] running on GCE node
I20260811 01:34:27.911670 7750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:27.913143 7750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:27.914402 7750 hybrid_clock.cc:648] HybridClock initialized: now 1786412067914334 us; error 69 us; skew 500 ppm
I20260811 01:34:27.914769 7750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:27 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412067, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:27.918265 7750 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:27.919952 7750 webserver.cc:460] Webserver started at http://127.23.39.193:44611/ using document root <none> and password file <none>
I20260811 01:34:27.920675 7750 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:27.920837 7750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:27.926978 7750 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:34:27.930147 7789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:27.931576 7750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:34:27.931782 7750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "e386f8288f9e4846a77587b9fdc0a606"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "79d45f02b33b8c3cbd97a0cfb92902dd"
server_key_iv: "030e472eb45f4b2b4399b639c62a8cca"
server_key_version: "encryptionkey@0"
I20260811 01:34:27.932797 7750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:27.947825 7750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:27.952039 7750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:27.952339 7750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:27.953338 7750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:27.954792 7750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:27.954924 7750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:27.955055 7750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:27.955142 7750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:27.989053 7750 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:46093
I20260811 01:34:27.989152 7917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:46093 every 8 connection(s)
I20260811 01:34:27.990628 7750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:27.995460 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7750
I20260811 01:34:27.996132 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:46581
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=32867
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:27 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412067, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:28.014079 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:27.993620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:39741)
0811 01:34:27.994446 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:27.994483 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:27.996262 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:27.997661 (+ 1399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:27.997672 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:27.998341 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:27.998845 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:27.998861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.000567 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.000573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.001881 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:28.001894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.002969 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.002977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.003279 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.004019 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:28.004041 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:28.006312 (+ 2271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:28.009797 (+ 3485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.009806 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.009820 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.010338 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.010813 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.010818 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.010822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.011017 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.011807 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:28.011816 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:28.012149 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 01:34:28.012423 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 01:34:28.012881 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":382,"threads_started":1}
I20260811 01:34:28.014556 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:27.993536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:39741 (local address 127.23.39.254:42621)
0811 01:34:27.994297 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:27.994313 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:27.994609 (+ 296us) server_negotiation.cc:407] Connection header received
0811 01:34:27.996840 (+ 2231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:27.996852 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:27.997184 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:27.997511 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:27.999097 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.000398 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.002028 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.002724 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.002922 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.006583 (+ 3661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:28.006590 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:28.006605 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:28.006646 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:28.009613 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.010493 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.010499 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.010505 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.010673 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.011149 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.011159 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.011161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.011654 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:28.011869 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:28.012729 (+ 860us) server_negotiation.cc:299] Negotiation successful
0811 01:34:28.013215 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":290,"threads_started":1}
I20260811 01:34:28.017505 7918 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:28.017874 7918 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:28.018894 7918 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:28.021696 7708 ts_manager.cc:194] Registered new tserver with Master: e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093)
I20260811 01:34:28.024278 7708 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:39741
W20260811 01:34:28.350268 7922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:28.350575 7922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:28.350679 7922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:28.358217 7922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:28.358340 7922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:28.358460 7922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:28.368995 7922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:46581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=32867
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:28.370507 7922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:28.371865 7922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:28.386070 7931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:28.386183 7929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:28.386183 7928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:28.387099 7922 server_base.cc:1034] running on GCE node
I20260811 01:34:28.387773 7922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:28.388767 7922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:28.389999 7922 hybrid_clock.cc:648] HybridClock initialized: now 1786412068389951 us; error 42 us; skew 500 ppm
I20260811 01:34:28.390359 7922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:28 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412068, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:28.393600 7922 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:28.395102 7922 webserver.cc:460] Webserver started at http://127.23.39.194:32867/ using document root <none> and password file <none>
I20260811 01:34:28.395792 7922 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:28.395962 7922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:28.401262 7922 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 01:34:28.403949 7939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.405285 7922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:34:28.405470 7922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
format_stamp: "Formatted at 2026-08-11 01:34:25 on dist-test-slave-9jjr"
server_key: "42814a4c24a52888b239d96aba160c8b"
server_key_iv: "ea7781b022a819b1e4442351be684440"
server_key_version: "encryptionkey@0"
I20260811 01:34:28.406526 7922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:28.420097 7922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:28.424678 7922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:28.424996 7922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:28.426038 7922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:28.427569 7922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:28.427693 7922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.427834 7922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:28.427925 7922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.465070 7922 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:46581
I20260811 01:34:28.465135 8071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:46581 every 8 connection(s)
I20260811 01:34:28.466698 7922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:28.469821 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 7922
I20260811 01:34:28.470567 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:46419
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=32917
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:34:28 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412068, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:28.491151 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.470823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:37907 (local address 127.23.39.254:42621)
0811 01:34:28.471013 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:28.471019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:28.471393 (+ 374us) server_negotiation.cc:407] Connection header received
0811 01:34:28.474400 (+ 3007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:28.474406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:28.474672 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:28.474803 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:28.477034 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.478208 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.480783 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.481218 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.481320 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.485246 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:28.485251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:28.485254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:28.485288 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:28.487922 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.488685 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.488690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.488698 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.488826 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.489281 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.489288 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.489292 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.489583 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:28.489757 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:28.490547 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 01:34:28.490785 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:34:28.492201 8075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.470304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:37907)
0811 01:34:28.471216 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:28.471269 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:28.474022 (+ 2753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:28.475086 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:28.475100 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:28.475928 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:28.476806 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:28.476849 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.478386 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.478394 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.480598 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:28.480634 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.481454 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.481464 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.481818 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.482619 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:28.482654 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:28.485012 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:28.488069 (+ 3057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.488078 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.488095 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.488534 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.488942 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.488947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.488950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.489160 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.489720 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:28.489728 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:28.490088 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 01:34:28.490445 (+ 357us) client_negotiation.cc:240] Negotiation successful
0811 01:34:28.490996 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":613,"threads_started":1}
I20260811 01:34:28.493837 8072 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:28.494203 8072 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:28.494954 8072 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:28.496531 7708 ts_manager.cc:194] Registered new tserver with Master: 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581)
I20260811 01:34:28.497885 7708 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:37907
W20260811 01:34:28.829782 8076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:28.830107 8076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:28.830358 8076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:28.838778 8076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:28.838907 8076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:28.839025 8076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:28.849220 8076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:46419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=32917
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:28.850580 8076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:28.851929 8076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:28.865892 8081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:28.865865 8084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:28.865922 8082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:28.867081 8076 server_base.cc:1034] running on GCE node
I20260811 01:34:28.867875 8076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:28.869043 8076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:28.870321 8076 hybrid_clock.cc:648] HybridClock initialized: now 1786412068870233 us; error 52 us; skew 500 ppm
I20260811 01:34:28.870851 8076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:28 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412068, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:28.874439 8076 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:28.876116 8076 webserver.cc:460] Webserver started at http://127.23.39.195:32917/ using document root <none> and password file <none>
I20260811 01:34:28.876876 8076 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:28.877050 8076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:28.883034 8076 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:34:28.886279 8092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.887943 8076 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:34:28.888165 8076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "b04fc2c167014e449983290ecefcae01"
format_stamp: "Formatted at 2026-08-11 01:34:26 on dist-test-slave-9jjr"
server_key: "3839a065e296f423d9aa3dfff2f4a9eb"
server_key_iv: "e003e602eb186f617d1a40959d872106"
server_key_version: "encryptionkey@0"
I20260811 01:34:28.889297 8076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:28.904443 8076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:28.909344 8076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:28.909667 8076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:28.910831 8076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:28.912221 8076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:28.912375 8076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.912513 8076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:28.912603 8076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:28.949100 8076 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46419
I20260811 01:34:28.949167 8221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46419 every 8 connection(s)
I20260811 01:34:28.950717 8076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:28.953685 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8076
Aug 11 01:34:28 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412068, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:28.973054 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.953316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:33321 (local address 127.23.39.254:42621)
0811 01:34:28.953560 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:28.953566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:28.954860 (+ 1294us) server_negotiation.cc:407] Connection header received
0811 01:34:28.956856 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:28.956861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:28.956954 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:28.957066 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:28.958645 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.959395 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.961150 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.961593 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.961734 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.965934 (+ 4200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:28.965940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:28.965945 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:28.965984 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:28.969278 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.970322 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.970326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.970328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.970456 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.970989 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.970992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.970994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.971254 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:28.971360 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:28.972377 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 01:34:28.972640 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:34:28.973811 8226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.953871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:33321)
0811 01:34:28.954707 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:28.954754 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:28.956544 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:28.957309 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:28.957317 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:28.957838 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:28.958471 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:28.958488 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.959577 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.959581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.960989 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:28.961007 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.961841 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.961849 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:28.962094 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.963043 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:28.963106 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:28.965714 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:28.969418 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.969430 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.969449 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.970174 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.970576 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:28.970582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:28.970586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:28.970868 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:28.971391 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:28.971399 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:28.971882 (+ 483us) client_negotiation.cc:769] Sending connection context
0811 01:34:28.972203 (+ 321us) client_negotiation.cc:240] Negotiation successful
0811 01:34:28.972636 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":392,"threads_started":1}
I20260811 01:34:28.975365 8223 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42621
I20260811 01:34:28.975720 8223 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:28.976661 8223 heartbeater.cc:511] Master 127.23.39.254:42621 requested a full tablet report, sending...
I20260811 01:34:28.978169 7708 ts_manager.cc:194] Registered new tserver with Master: b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:28.978639 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.954651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.23.39.254:42621)
0811 01:34:28.962594 (+ 7943us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:28.962600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:28.963006 (+ 406us) server_negotiation.cc:407] Connection header received
0811 01:34:28.963171 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:28.963179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:28.963255 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:28.963384 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:28.965179 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.966006 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.967843 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.968600 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.968781 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.972304 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:28.972310 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:28.972315 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:28.972346 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:28.975552 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.976321 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.976328 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.976332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.976479 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:28.976902 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:28.976906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:28.976908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:28.977190 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:28.977467 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:28.977789 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 01:34:28.978009 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7812,"spinlock_wait_cycles":1408,"thread_start_us":7668,"threads_started":1}
I20260811 01:34:28.979307 7708 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:33321
I20260811 01:34:28.981559 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:34:28.987977 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:28.982524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.23.39.254:42621)
0811 01:34:28.982693 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:28.982697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:28.983216 (+ 519us) server_negotiation.cc:407] Connection header received
0811 01:34:28.983388 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:28.983392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:28.983515 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:28.983631 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:34:28.984020 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.984677 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.986035 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:28.986521 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:28.986615 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:28.987060 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:34:28.987509 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:34:28.987624 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:28.987702 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 01:34:28.987780 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:34:28.988935 7708 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:34:28.996343 7708 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:34:29.022096 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.008468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39950 (local address 127.23.39.194:46581)
0811 01:34:29.009088 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.009098 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.009466 (+ 368us) server_negotiation.cc:407] Connection header received
0811 01:34:29.009887 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.009898 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.010237 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.010443 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:29.011655 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.013759 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.017889 (+ 4130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.020121 (+ 2232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.020281 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.020577 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.021551 (+ 974us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.021784 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":884,"threads_started":1}
I20260811 01:34:29.022912 8235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.008172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46581 (local address 127.0.0.1:39950)
0811 01:34:29.009308 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.009355 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:29.009618 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:29.010860 (+ 1242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:29.010871 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:29.010915 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:29.011396 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.011414 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.013998 (+ 2584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.014006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.017591 (+ 3585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.017618 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.020873 (+ 3255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.020883 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.021202 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.021284 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 01:34:29.022357 (+ 1073us) client_negotiation.cc:240] Negotiation successful
0811 01:34:29.022609 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":660,"threads_started":1}
I20260811 01:34:29.027275 7996 tablet_service.cc:1467] Processing CreateTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 (DEFAULT_TABLE table=test-table [id=fca64c4a34064a9b8e0afcebbb1c521f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:29.028555 7918 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
I20260811 01:34:29.028894 7996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:29.031689 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.009806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55638)
0811 01:34:29.021658 (+ 11852us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.021686 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:29.021870 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:29.023803 (+ 1933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:29.023807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:29.023837 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:29.024104 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.024112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.026097 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.026104 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.028381 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.028396 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.030730 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.030737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.030906 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.030955 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 01:34:29.031041 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 01:34:29.031203 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11704,"mutex_wait_us":3,"thread_start_us":11558,"threads_started":1}
I20260811 01:34:29.032250 8237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.008940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46419 (local address 127.0.0.1:40676)
0811 01:34:29.014393 (+ 5453us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.014414 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:29.014536 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:29.024545 (+ 10009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:29.024550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:29.024574 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:29.024938 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.024951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.026956 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.026961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.029200 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.029215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.031416 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.031423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.031626 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.031694 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 01:34:29.031788 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:34:29.031941 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5277,"thread_start_us":4924,"threads_started":1}
I20260811 01:34:29.032501 8243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.010064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55638 (local address 127.23.39.193:46093)
0811 01:34:29.021158 (+ 11094us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.021171 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.022702 (+ 1531us) server_negotiation.cc:407] Connection header received
0811 01:34:29.022862 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.022876 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.023260 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.023525 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:29.024330 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.025918 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.028585 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.030184 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.030325 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.030570 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.031984 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.032177 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10835,"thread_start_us":11930,"threads_started":1}
I20260811 01:34:29.033015 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.009701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40676 (local address 127.23.39.195:46419)
0811 01:34:29.023943 (+ 14242us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.023953 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.023987 (+ 34us) server_negotiation.cc:407] Connection header received
0811 01:34:29.024088 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.024095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.024329 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.024540 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:29.025121 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.026785 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.029402 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.030894 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.031029 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.031251 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.032499 (+ 1248us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.032695 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14068,"thread_start_us":13881,"threads_started":1}
I20260811 01:34:29.035813 7844 tablet_service.cc:1467] Processing CreateTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 (DEFAULT_TABLE table=test-table [id=fca64c4a34064a9b8e0afcebbb1c521f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:29.037288 7844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:29.040025 8149 tablet_service.cc:1467] Processing CreateTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 (DEFAULT_TABLE table=test-table [id=fca64c4a34064a9b8e0afcebbb1c521f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:29.041551 8149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:29.044422 8244 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Bootstrap starting.
I20260811 01:34:29.048508 8244 tablet_bootstrap.cc:654] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:29.050030 8244 log.cc:824] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:29.053972 8244 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: No bootstrap required, opened a new log
I20260811 01:34:29.054356 8244 ts_tablet_manager.cc:1397] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:34:29.054986 8246 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Bootstrap starting.
I20260811 01:34:29.055920 8247 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Bootstrap starting.
I20260811 01:34:29.058832 8246 tablet_bootstrap.cc:654] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:29.059410 8247 tablet_bootstrap.cc:654] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:29.060184 8246 log.cc:824] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:29.060722 8247 log.cc:824] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:29.063470 8247 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: No bootstrap required, opened a new log
I20260811 01:34:29.063665 8246 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: No bootstrap required, opened a new log
I20260811 01:34:29.063786 8247 ts_tablet_manager.cc:1397] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 01:34:29.063928 8246 ts_tablet_manager.cc:1397] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:34:29.065848 8244 raft_consensus.cc:348] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.066391 8244 raft_consensus.cc:374] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:29.066506 8244 raft_consensus.cc:729] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2ec7788b654ab49a78bfa02c68aa7b, State: Initialized, Role: FOLLOWER
I20260811 01:34:29.067201 8244 consensus_queue.cc:260] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.069939 8072 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
I20260811 01:34:29.070727 8244 ts_tablet_manager.cc:1428] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
I20260811 01:34:29.073066 8247 raft_consensus.cc:348] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.073474 8247 raft_consensus.cc:374] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:29.073598 8247 raft_consensus.cc:729] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04fc2c167014e449983290ecefcae01, State: Initialized, Role: FOLLOWER
I20260811 01:34:29.074321 8247 consensus_queue.cc:260] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.074947 8246 raft_consensus.cc:348] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.075445 8246 raft_consensus.cc:374] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:29.075567 8246 raft_consensus.cc:729] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e386f8288f9e4846a77587b9fdc0a606, State: Initialized, Role: FOLLOWER
I20260811 01:34:29.075762 8223 heartbeater.cc:503] Master 127.23.39.254:42621 was elected leader, sending a full tablet report...
I20260811 01:34:29.076267 8247 ts_tablet_manager.cc:1428] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260811 01:34:29.076189 8246 consensus_queue.cc:260] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.078310 8246 ts_tablet_manager.cc:1428] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260811 01:34:29.139752 8250 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:29.140125 8250 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.142207 8250 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:29.151854 8243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.142932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:47505 (local address 127.23.39.193:46093)
0811 01:34:29.143214 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.143260 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.143708 (+ 448us) server_negotiation.cc:407] Connection header received
0811 01:34:29.144033 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.144040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.144124 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.144226 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:29.145029 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.146197 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.149278 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.150567 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.150750 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.150813 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.151449 (+ 636us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.151584 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:34:29.151851 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.142982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:41445 (local address 127.23.39.195:46419)
0811 01:34:29.143209 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.143217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.144014 (+ 797us) server_negotiation.cc:407] Connection header received
0811 01:34:29.144122 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.144127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.144211 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.144309 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:29.145134 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.146262 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.149291 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.150572 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.150736 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.150813 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.151449 (+ 636us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.151584 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:34:29.152119 8255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.142678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46419 (local address 127.23.39.194:41445)
0811 01:34:29.143892 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.143911 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:29.144022 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:29.144336 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:29.144342 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:29.144370 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:29.144949 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.144960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.146396 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.146405 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.149083 (+ 2678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.149100 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.150882 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.150887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.151167 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.151296 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 01:34:29.151399 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:34:29.151568 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"mutex_wait_us":263,"thread_start_us":835,"threads_started":1}
I20260811 01:34:29.152458 8254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.142367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.23.39.194:47505)
0811 01:34:29.143568 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.143592 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:29.143833 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:29.144255 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:29.144258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:29.144303 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:29.144859 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.144880 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.146349 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.146354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.149083 (+ 2729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:29.149100 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.150877 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.150884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:29.151165 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.151296 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 01:34:29.151399 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:34:29.151568 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":343,"thread_start_us":860,"threads_started":1}
I20260811 01:34:29.153288 8171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff1b20e4f5f4c66a9dd5d3eac1d2686" candidate_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04fc2c167014e449983290ecefcae01" is_pre_election: true
I20260811 01:34:29.153558 7872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff1b20e4f5f4c66a9dd5d3eac1d2686" candidate_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e386f8288f9e4846a77587b9fdc0a606" is_pre_election: true
I20260811 01:34:29.153923 8171 raft_consensus.cc:2454] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2ec7788b654ab49a78bfa02c68aa7b in term 0.
I20260811 01:34:29.154057 7872 raft_consensus.cc:2454] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2ec7788b654ab49a78bfa02c68aa7b in term 0.
I20260811 01:34:29.154753 7943 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01; no voters:
I20260811 01:34:29.155203 8250 raft_consensus.cc:2781] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:34:29.155393 8250 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:34:29.155503 8250 raft_consensus.cc:3037] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:29.157749 8250 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.158428 8250 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [CANDIDATE]: Term 1 election: Requested vote from peers e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
I20260811 01:34:29.158931 8171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff1b20e4f5f4c66a9dd5d3eac1d2686" candidate_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04fc2c167014e449983290ecefcae01"
I20260811 01:34:29.158957 7872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff1b20e4f5f4c66a9dd5d3eac1d2686" candidate_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e386f8288f9e4846a77587b9fdc0a606"
I20260811 01:34:29.159143 8171 raft_consensus.cc:3037] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:29.159150 7872 raft_consensus.cc:3037] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:29.161496 7872 raft_consensus.cc:2454] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2ec7788b654ab49a78bfa02c68aa7b in term 1.
I20260811 01:34:29.161598 8171 raft_consensus.cc:2454] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2ec7788b654ab49a78bfa02c68aa7b in term 1.
I20260811 01:34:29.162009 7941 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d2ec7788b654ab49a78bfa02c68aa7b, e386f8288f9e4846a77587b9fdc0a606; no voters:
I20260811 01:34:29.162405 8250 raft_consensus.cc:2781] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:29.162901 8250 raft_consensus.cc:686] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 LEADER]: Becoming Leader. State: Replica: 3d2ec7788b654ab49a78bfa02c68aa7b, State: Running, Role: LEADER
I20260811 01:34:29.163384 8250 consensus_queue.cc:237] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:29.169073 7708 catalog_manager.cc:5495] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194). New cstate: current_term: 1 leader_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } health_report { overall_health: UNKNOWN } } }
I20260811 01:34:29.186103 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.180547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39962 (local address 127.23.39.194:46581)
0811 01:34:29.180725 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.180730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.180749 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:34:29.180934 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.180941 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.181065 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.181222 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:34:29.181562 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.182334 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.184013 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.184424 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.184516 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.185014 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:34:29.185561 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:34:29.185675 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.185808 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.185878 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 01:34:29.194967 7872 raft_consensus.cc:1261] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Refusing update from remote peer 3d2ec7788b654ab49a78bfa02c68aa7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:29.194967 8171 raft_consensus.cc:1261] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Refusing update from remote peer 3d2ec7788b654ab49a78bfa02c68aa7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:29.196056 8256 consensus_queue.cc:1035] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:29.196419 8250 consensus_queue.cc:1035] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:34:29.202432 8225 tablet.cc:2369] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:29.206621 8259 mvcc.cc:205] Tried to move back new op lower bound from 7317143835410952192 to 7317143835297316864. Current Snapshot: MvccSnapshot[applied={T|T < 7317143835410952192}]
I20260811 01:34:29.211545 8260 mvcc.cc:205] Tried to move back new op lower bound from 7317143835410952192 to 7317143835297316864. Current Snapshot: MvccSnapshot[applied={T|T < 7317143835410952192}]
I20260811 01:34:29.222615 7707 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:29.222973 7707 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:29.226609 7707 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Sending DeleteTablet for 3 replicas of tablet dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:29.228019 7996 tablet_service.cc:1514] Processing DeleteTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:29 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:39950
I20260811 01:34:29.228086 8149 tablet_service.cc:1514] Processing DeleteTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:29 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:40676
I20260811 01:34:29.228201 7844 tablet_service.cc:1514] Processing DeleteTablet for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:29 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:55638
I20260811 01:34:29.229409 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7750
I20260811 01:34:29.238276 8274 tablet_replica.cc:330] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: stopping tablet replica
I20260811 01:34:29.238940 8274 raft_consensus.cc:2229] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:34:29.239846 8274 raft_consensus.cc:2258] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:29.240720 8275 tablet_replica.cc:330] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: stopping tablet replica
I20260811 01:34:29.241201 8273 tablet_replica.cc:330] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: stopping tablet replica
I20260811 01:34:29.241309 8275 raft_consensus.cc:2229] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:29.241611 8273 raft_consensus.cc:2229] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:29.241839 8275 raft_consensus.cc:2258] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:29.242110 8273 raft_consensus.cc:2258] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:29.244184 8274 ts_tablet_manager.cc:1905] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:29.244264 8273 ts_tablet_manager.cc:1905] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:29.251457 8273 ts_tablet_manager.cc:1918] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:29.251644 8273 log.cc:1196] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:29.251621 8274 ts_tablet_manager.cc:1918] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:29.251798 8274 log.cc:1196] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:29.252262 8273 ts_tablet_manager.cc:1939] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P b04fc2c167014e449983290ecefcae01: Deleting consensus metadata
I20260811 01:34:29.252424 8274 ts_tablet_manager.cc:1939] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P 3d2ec7788b654ab49a78bfa02c68aa7b: Deleting consensus metadata
I20260811 01:34:29.252810 8243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.230413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55644 (local address 127.23.39.193:46093)
0811 01:34:29.231041 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.231047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.231065 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:34:29.231120 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.231125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.231202 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.231310 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:29.233394 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.234601 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.237440 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.238151 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.238283 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.243818 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:29.243833 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:29.243851 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:29.243897 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:29.248140 (+ 4243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.249205 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.249217 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.249222 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.249392 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.249891 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.249896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.249899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.250448 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:29.250780 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.252023 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.252282 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502}
I20260811 01:34:29.254216 7692 catalog_manager.cc:4841] TS b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 (table test-table [id=fca64c4a34064a9b8e0afcebbb1c521f]) successfully deleted
I20260811 01:34:29.254397 7690 catalog_manager.cc:4841] TS 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): tablet dff1b20e4f5f4c66a9dd5d3eac1d2686 (table test-table [id=fca64c4a34064a9b8e0afcebbb1c521f]) successfully deleted
I20260811 01:34:29.254598 7913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:29.347167 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7750
W20260811 01:34:29.373309 7690 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:46093 (error 108)
I20260811 01:34:29.373687 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7922
I20260811 01:34:29.375694 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.375129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55646)
0811 01:34:29.375369 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.375509 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
W20260811 01:34:29.376003 7690 catalog_manager.cc:4584] TS e386f8288f9e4846a77587b9fdc0a606 (127.23.39.193:46093): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dff1b20e4f5f4c66a9dd5d3eac1d2686: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
I20260811 01:34:29.390941 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.374934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39966 (local address 127.23.39.194:46581)
0811 01:34:29.375125 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.375131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.375152 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:34:29.375262 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.375268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.375348 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.375476 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:29.377130 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.378460 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.380000 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.380694 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.380846 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.383790 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:29.383808 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:29.383828 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:29.383874 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:29.387838 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.388540 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.388549 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.388552 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.388725 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.389131 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.389137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.389140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.389625 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:29.389964 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.390231 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.390472 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:34:29.391829 8066 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:29.430084 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.429482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55662)
0811 01:34:29.429747 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.429867 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:34:29.431274 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.430872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55668)
0811 01:34:29.431043 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.431132 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 01:34:29.491779 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.491181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55680)
0811 01:34:29.491426 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.491558 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 01:34:29.492937 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.492525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55694)
0811 01:34:29.492713 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.492800 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 01:34:29.509466 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7922
I20260811 01:34:29.531765 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 8076
I20260811 01:34:29.546298 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.532542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40686 (local address 127.23.39.195:46419)
0811 01:34:29.532726 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:29.532732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:29.532906 (+ 174us) server_negotiation.cc:407] Connection header received
0811 01:34:29.533119 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:29.533123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:29.533188 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:29.533304 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:29.534834 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.535561 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.536974 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:29.537386 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:29.537529 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:29.540332 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:29.540356 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:29.540371 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:29.540412 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:29.543340 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.544044 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.544052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.544054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.544206 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:29.544604 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:29.544609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:29.544612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:29.545001 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:29.545328 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:29.545666 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 01:34:29.545911 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 01:34:29.546949 8217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:29.573834 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.573276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55700)
0811 01:34:29.573528 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.573646 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 01:34:29.575024 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.574592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55708)
0811 01:34:29.574811 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.574895 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260811 01:34:29.639400 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 8076
I20260811 01:34:29.660353 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 7669
I20260811 01:34:29.661670 7742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:29.780723 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:29.780174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:46093 (local address 127.0.0.1:55718)
0811 01:34:29.780358 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:29.780514 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:46093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:34:29.780725 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 7669
I20260811 01:34:29.806602 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--webserver_interface=127.23.39.254
--webserver_port=33825
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:30.152108 8281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:30.152498 8281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:30.152654 8281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:30.159981 8281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:30.160143 8281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:30.160265 8281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:30.160378 8281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:30.160456 8281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:30.172434 8281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=33825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:30.173894 8281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:30.175271 8281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:30.187393 8288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:30.187433 8290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:30.187486 8287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:30.188498 8281 server_base.cc:1034] running on GCE node
I20260811 01:34:30.189322 8281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:30.190843 8281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:30.192078 8281 hybrid_clock.cc:648] HybridClock initialized: now 1786412070192028 us; error 59 us; skew 500 ppm
I20260811 01:34:30.192447 8281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:30 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:30.195675 8281 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:30.197202 8281 webserver.cc:460] Webserver started at http://127.23.39.254:33825/ using document root <none> and password file <none>
I20260811 01:34:30.197901 8281 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:30.198058 8281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:30.206167 8281 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:34:30.209873 8297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:30.211354 8281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:30.211513 8281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "cb4182c2c935485fb39565ab17885c2e"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "afea93e6dfd89aa6e520d74391b515df"
server_key_iv: "fd9acb0a02efc93375221fb1abe5d68e"
server_key_version: "encryptionkey@0"
I20260811 01:34:30.212492 8281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:30.251446 8281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:30.255456 8281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:30.255734 8281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:30.275089 8281 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42621
I20260811 01:34:30.275099 8354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42621 every 8 connection(s)
I20260811 01:34:30.276762 8281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:30.283599 8355 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:34:30.286559 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8281
I20260811 01:34:30.287050 8355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap starting.
I20260811 01:34:30.287477 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:46093
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=44611
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:30.308039 8355 log.cc:824] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:30.325392 8355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:34:30.325989 8355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e: Bootstrap complete.
I20260811 01:34:30.335647 8355 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:30.336599 8355 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Initialized, Role: FOLLOWER
I20260811 01:34:30.337249 8355 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:30.337498 8355 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:30.337628 8355 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:30.337828 8355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:34:30.341745 8355 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:30.342309 8355 leader_election.cc:302] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4182c2c935485fb39565ab17885c2e; no voters:
I20260811 01:34:30.343043 8355 leader_election.cc:288] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:34:30.343255 8363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:34:30.344558 8363 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [term 3 LEADER]: Becoming Leader. State: Replica: cb4182c2c935485fb39565ab17885c2e, State: Running, Role: LEADER
I20260811 01:34:30.345134 8363 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } }
I20260811 01:34:30.345481 8355 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:30.347913 8365 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4182c2c935485fb39565ab17885c2e. Latest consensus state: current_term: 3 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:30.348304 8365 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:30.348883 8364 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "cb4182c2c935485fb39565ab17885c2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4182c2c935485fb39565ab17885c2e" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42621 } } }
I20260811 01:34:30.349170 8364 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4182c2c935485fb39565ab17885c2e [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:30.358218 8371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:30.367125 8371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:30.368691 8371 catalog_manager.cc:1259] Loaded cluster ID: 54089a699cc84970b770a0bc061a1565
I20260811 01:34:30.368855 8371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 01:34:30.372030 8371 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbe882dd9ad google::LogMessage::Fail() at ??:0
@ 0x7fbe882e088a google::LogMessage::SendToLog() at ??:0
@ 0x7fbe882dd4de google::LogMessage::Flush() at ??:0
@ 0x7fbe882dea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbe9dd10512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fbe9dd0d976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbe9dd95610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fbe9dd95439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbe8af29345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbe8af2c91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fbe8af2c799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbe8af07eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbe8e1e16db start_thread at ??:0
@ 0x7fbe8717761f clone at ??:0
W20260811 01:34:30.749866 8358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:30.750258 8358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:30.750381 8358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:30.758091 8358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:30.758296 8358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:30.758421 8358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:30.768900 8358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:46093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=44611
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:30.770252 8358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:30.771839 8358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:30.786052 8403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:30.786002 8404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:30.786026 8406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:30.786880 8358 server_base.cc:1034] running on GCE node
I20260811 01:34:30.787575 8358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:30.788579 8358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:30.789827 8358 hybrid_clock.cc:648] HybridClock initialized: now 1786412070789782 us; error 26 us; skew 500 ppm
I20260811 01:34:30.790176 8358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:30 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:30.793402 8358 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:30.794988 8358 webserver.cc:460] Webserver started at http://127.23.39.193:44611/ using document root <none> and password file <none>
I20260811 01:34:30.795679 8358 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:30.795799 8358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:30.801463 8358 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:34:30.804536 8413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:30.805927 8358 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 01:34:30.806066 8358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "e386f8288f9e4846a77587b9fdc0a606"
format_stamp: "Formatted at 2026-08-11 01:34:24 on dist-test-slave-9jjr"
server_key: "79d45f02b33b8c3cbd97a0cfb92902dd"
server_key_iv: "030e472eb45f4b2b4399b639c62a8cca"
server_key_version: "encryptionkey@0"
I20260811 01:34:30.807120 8358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:30.834420 8358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:30.839020 8358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:30.839278 8358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:30.840528 8358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:30.842525 8422 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 01:34:30.848673 8358 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:34:30.848831 8358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260811 01:34:30.849020 8358 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:34:30.852566 8358 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:34:30.852662 8358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.000s sys 0.001s
I20260811 01:34:30.853055 8422 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Bootstrap starting.
I20260811 01:34:30.862288 8422 log.cc:824] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:30.879289 8422 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:34:30.880280 8422 tablet_bootstrap.cc:492] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Bootstrap complete.
I20260811 01:34:30.881072 8422 ts_tablet_manager.cc:1397] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Time spent bootstrapping tablet: real 0.028s user 0.020s sys 0.004s
I20260811 01:34:30.892637 8422 raft_consensus.cc:348] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:30.894246 8422 raft_consensus.cc:729] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e386f8288f9e4846a77587b9fdc0a606, State: Initialized, Role: FOLLOWER
I20260811 01:34:30.895049 8422 consensus_queue.cc:260] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:30.896162 8358 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:46093
I20260811 01:34:30.896204 8547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:46093 every 8 connection(s)
I20260811 01:34:30.897011 8422 ts_tablet_manager.cc:1428] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260811 01:34:30.897490 8358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:30.900935 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8358
I20260811 01:34:30.901621 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:46581
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=32867
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:30.902498 8551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:30.900197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:44023)
0811 01:34:30.901090 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:30.901431 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":395,"threads_started":1}
W20260811 01:34:30.903110 8549 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:42621 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:42621: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
I20260811 01:34:30.904021 8551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:30.903698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:51431)
0811 01:34:30.903856 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:30.903926 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 01:34:30.905018 8551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:30.904565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:43717)
0811 01:34:30.904753 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:30.904852 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:34:30.905323 8549 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:34:31.249312 8552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:31.249611 8552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:31.249797 8552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:31.257051 8552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:31.257170 8552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:31.257373 8552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:31.267247 8552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:46581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=32867
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:31.268639 8552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:31.269989 8552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:31.283504 8560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:31.283505 8558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:31.283933 8557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:31.284305 8552 server_base.cc:1034] running on GCE node
I20260811 01:34:31.284897 8552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:31.285780 8552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:31.286994 8552 hybrid_clock.cc:648] HybridClock initialized: now 1786412071286957 us; error 32 us; skew 500 ppm
I20260811 01:34:31.287284 8552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:31 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412071, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:31.290555 8552 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:31.292114 8552 webserver.cc:460] Webserver started at http://127.23.39.194:32867/ using document root <none> and password file <none>
I20260811 01:34:31.292774 8552 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:31.292879 8552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:31.298343 8552 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:31.300936 8570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.302354 8552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:31.302491 8552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "3d2ec7788b654ab49a78bfa02c68aa7b"
format_stamp: "Formatted at 2026-08-11 01:34:25 on dist-test-slave-9jjr"
server_key: "42814a4c24a52888b239d96aba160c8b"
server_key_iv: "ea7781b022a819b1e4442351be684440"
server_key_version: "encryptionkey@0"
I20260811 01:34:31.303470 8552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:31.319097 8552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:31.323549 8552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:31.323846 8552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:31.324852 8552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:31.326229 8552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:31.326341 8552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.326483 8552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:31.326572 8552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.360553 8552 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:46581
I20260811 01:34:31.360641 8695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:46581 every 8 connection(s)
I20260811 01:34:31.362080 8552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:31.363656 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8552
I20260811 01:34:31.364499 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:46419
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:42621
--webserver_port=32917
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:34:31.367426 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.365460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:39389)
0811 01:34:31.366345 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.366555 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":317,"threads_started":1}
W20260811 01:34:31.368218 8696 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:42621 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:42621: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
I20260811 01:34:31.373452 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.372936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:42191)
0811 01:34:31.373186 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.373293 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260811 01:34:31.374408 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.374031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:35317)
0811 01:34:31.374204 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.374293 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:34:31.374681 8696 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:34:31.717665 8699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:31.717958 8699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:31.718057 8699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:31.725508 8699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:31.725634 8699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:31.725754 8699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:31.735930 8699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:46419
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=32917
--tserver_master_addrs=127.23.39.254:42621
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:31.737255 8699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:31.738606 8699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:31.752453 8705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:31.752485 8708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:31.752369 8706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:31.753427 8699 server_base.cc:1034] running on GCE node
I20260811 01:34:31.754079 8699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:31.755141 8699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:31.756382 8699 hybrid_clock.cc:648] HybridClock initialized: now 1786412071756334 us; error 41 us; skew 500 ppm
I20260811 01:34:31.756707 8699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:31 dist-test-slave-9jjr krb5kdc[7062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412071, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:31.759958 8699 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:31.761471 8699 webserver.cc:460] Webserver started at http://127.23.39.195:32917/ using document root <none> and password file <none>
I20260811 01:34:31.762256 8699 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:31.762410 8699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:31.768009 8699 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:34:31.771112 8715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.772502 8699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:34:31.772683 8699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "b04fc2c167014e449983290ecefcae01"
format_stamp: "Formatted at 2026-08-11 01:34:26 on dist-test-slave-9jjr"
server_key: "3839a065e296f423d9aa3dfff2f4a9eb"
server_key_iv: "e003e602eb186f617d1a40959d872106"
server_key_version: "encryptionkey@0"
I20260811 01:34:31.773767 8699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:31.794525 8699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:31.798691 8699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:31.798977 8699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:31.800038 8699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:31.801478 8699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:31.801622 8699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.801748 8699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:31.801836 8699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:31.838164 8699 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46419
I20260811 01:34:31.838203 8840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46419 every 8 connection(s)
I20260811 01:34:31.839684 8699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:31.844700 8843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.842796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:54741)
0811 01:34:31.843554 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.843785 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":300,"threads_started":1}
W20260811 01:34:31.845489 8841 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:42621 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:42621: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
I20260811 01:34:31.846459 8843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.846030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:48145)
0811 01:34:31.846276 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.846348 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 01:34:31.847364 8843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.847052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:59883)
0811 01:34:31.847184 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.847259 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 01:34:31.847645 8841 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:34:31.847688 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8699
I20260811 01:34:31.906622 8845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:31.905815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:55279)
0811 01:34:31.906319 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:31.906435 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":202,"threads_started":1}
I20260811 01:34:32.376416 8846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.375425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:56413)
0811 01:34:32.376020 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:32.376151 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":263,"threads_started":1}
I20260811 01:34:32.389884 8847 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:32.390285 8847 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:32.392045 8847 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
Aug 11 01:34:32 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
Aug 11 01:34:32 dist-test-slave-9jjr krb5kdc[7062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412070, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:34:32.421195 8845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.392485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46419 (local address 127.23.39.193:51985)
0811 01:34:32.392819 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:32.392860 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:32.393488 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:32.396867 (+ 3379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:32.396881 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:32.397665 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:32.398410 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:32.398431 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.399998 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.400001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:32.401729 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:32.401751 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.403217 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.403223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:32.403582 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:32.408462 (+ 4880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:32.408506 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:32.412440 (+ 3934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:32.417066 (+ 4626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:32.417074 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:32.417086 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:32.417702 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:32.418257 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:32.418264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:32.418268 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:32.418487 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:32.419390 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:32.419398 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:32.419794 (+ 396us) client_negotiation.cc:769] Sending connection context
0811 01:34:32.420073 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:34:32.420719 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":267,"spinlock_wait_cycles":34688}
I20260811 01:34:32.421200 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.392935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:51985 (local address 127.23.39.195:46419)
0811 01:34:32.394442 (+ 1507us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:32.394463 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:32.394515 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:34:32.396057 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:32.396065 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:32.396417 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:32.396758 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:32.398621 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.399796 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.401884 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.402931 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.403132 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:32.412879 (+ 9747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:32.412893 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:32.412911 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:32.412973 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:32.416877 (+ 3904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:32.417895 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:32.417904 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:32.417909 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:32.418093 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:32.418618 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:32.418623 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:32.418627 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:32.419209 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:32.419432 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:32.420326 (+ 894us) server_negotiation.cc:299] Negotiation successful
0811 01:34:32.420735 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1273,"thread_start_us":1111,"threads_started":1}
I20260811 01:34:32.421226 8851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.393023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:46999 (local address 127.23.39.194:46581)
0811 01:34:32.394809 (+ 1786us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:32.394825 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:32.395143 (+ 318us) server_negotiation.cc:407] Connection header received
0811 01:34:32.396794 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:32.396801 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:32.397163 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:32.397468 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:32.398664 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.399807 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.401954 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.402929 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.403132 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:32.412533 (+ 9401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:32.412550 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:32.412573 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:32.412649 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:32.416866 (+ 4217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:32.417873 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:32.417890 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:32.417897 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:32.418095 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:32.418626 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:32.418632 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:32.418635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:32.419259 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:32.419462 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:32.420340 (+ 878us) server_negotiation.cc:299] Negotiation successful
0811 01:34:32.420788 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1580,"thread_start_us":1415,"threads_started":1}
I20260811 01:34:32.421332 8849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.393003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:46581 (local address 127.23.39.193:46999)
0811 01:34:32.395019 (+ 2016us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:32.395033 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:32.395184 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:32.397428 (+ 2244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:32.397433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:32.398165 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:32.398479 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:32.398490 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.399998 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.400002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:32.401797 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:32.401811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:32.403204 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:32.403212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:32.403584 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:32.408462 (+ 4878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:32.408507 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:32.412060 (+ 3553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:32.417092 (+ 5032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:32.417096 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:32.417098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:32.417702 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:32.418284 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:32.418290 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:32.418294 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:32.418492 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:32.419403 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:32.419407 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:32.419779 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 01:34:32.420073 (+ 294us) client_negotiation.cc:240] Negotiation successful
0811 01:34:32.420902 (+ 829us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1910,"mutex_wait_us":480,"spinlock_wait_cycles":46336,"thread_start_us":1745,"threads_started":1}
W20260811 01:34:32.425010 8414 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
W20260811 01:34:32.425335 8416 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:32.425511 8416 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e386f8288f9e4846a77587b9fdc0a606; no voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01
I20260811 01:34:32.425976 8847 raft_consensus.cc:2726] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:34:32.849189 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.848224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:57601)
0811 01:34:32.848755 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:32.848942 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":263,"threads_started":1}
I20260811 01:34:32.908097 8845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:32.907605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:50305)
0811 01:34:32.907793 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:32.907888 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 01:34:33.378657 8855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:33.377691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:36787)
0811 01:34:33.378373 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:33.378469 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":251,"threads_started":1}
I20260811 01:34:33.851039 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:33.850240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:53627)
0811 01:34:33.850796 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:33.850879 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":302,"threads_started":1}
I20260811 01:34:33.909782 8857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:33.909017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:41771)
0811 01:34:33.909507 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:33.909592 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":245,"threads_started":1}
I20260811 01:34:34.273962 8858 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:34.274227 8858 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:34.274979 8858 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
W20260811 01:34:34.276017 8414 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
W20260811 01:34:34.276198 8416 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:34.276335 8416 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e386f8288f9e4846a77587b9fdc0a606; no voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01
I20260811 01:34:34.276620 8858 raft_consensus.cc:2726] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:34:34.380553 8859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:34.379688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:57393)
0811 01:34:34.380272 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:34.380367 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":238,"threads_started":1}
I20260811 01:34:34.858355 8861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:34.857239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:37699)
0811 01:34:34.857890 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:34.858020 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":328,"threads_started":1}
I20260811 01:34:34.911773 8862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:34.910861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:38959)
0811 01:34:34.911469 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:34.911584 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":362,"threads_started":1}
I20260811 01:34:35.382481 8863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:35.381599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:43241)
0811 01:34:35.382110 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:35.382282 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":261,"threads_started":1}
I20260811 01:34:35.860391 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:35.859552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:39629)
0811 01:34:35.860099 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:35.860196 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":263,"threads_started":1}
I20260811 01:34:35.913693 8865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:35.912850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:54039)
0811 01:34:35.913399 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:35.913485 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":291,"threads_started":1}
I20260811 01:34:35.951462 8866 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:35.951721 8866 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:35.952486 8866 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
W20260811 01:34:35.953492 8416 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
W20260811 01:34:35.953694 8414 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:35.953814 8414 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e386f8288f9e4846a77587b9fdc0a606; no voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01
I20260811 01:34:35.954206 8866 raft_consensus.cc:2726] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:34:36.384346 8867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:36.383542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:33189)
0811 01:34:36.384064 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:36.384161 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":278,"threads_started":1}
I20260811 01:34:36.862437 8868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:36.861545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:51265)
0811 01:34:36.862054 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:36.862252 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":264,"threads_started":1}
I20260811 01:34:36.915467 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:36.914731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:54393)
0811 01:34:36.915202 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:36.915285 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":234,"threads_started":1}
I20260811 01:34:37.386327 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:37.385436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:41031)
0811 01:34:37.385942 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:37.386039 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":270,"threads_started":1}
I20260811 01:34:37.864526 8871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:37.863574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:49487)
0811 01:34:37.864248 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:37.864342 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":389,"threads_started":1}
I20260811 01:34:37.917199 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:37.916366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:33063)
0811 01:34:37.916876 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:37.916962 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":261,"threads_started":1}
I20260811 01:34:38.388367 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:38.387481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:37619)
0811 01:34:38.388054 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:38.388167 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":268,"threads_started":1}
I20260811 01:34:38.454427 8874 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:38.454631 8874 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:38.455413 8874 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
W20260811 01:34:38.456593 8414 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
W20260811 01:34:38.456801 8416 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:38.456957 8416 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e386f8288f9e4846a77587b9fdc0a606; no voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01
I20260811 01:34:38.457295 8874 raft_consensus.cc:2726] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:34:38.866595 8875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:38.865618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:48209)
0811 01:34:38.866292 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:38.866394 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":256,"threads_started":1}
I20260811 01:34:38.918944 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:38.918080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:48161)
0811 01:34:38.918605 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:38.918736 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":258,"threads_started":1}
I20260811 01:34:39.390427 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:39.389482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:48343)
0811 01:34:39.390009 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:39.390108 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":289,"threads_started":1}
I20260811 01:34:39.868779 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:39.867752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:33345)
0811 01:34:39.868397 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:39.868551 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":390,"threads_started":1}
I20260811 01:34:39.921190 8879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:39.920122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:50241)
0811 01:34:39.920826 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:39.920951 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":338,"threads_started":1}
I20260811 01:34:40.392315 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:40.391508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:37505)
0811 01:34:40.392032 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:40.392136 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":249,"threads_started":1}
I20260811 01:34:40.870832 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:40.869864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:47091)
0811 01:34:40.870493 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:40.870597 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":382,"threads_started":1}
I20260811 01:34:40.923313 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:40.922375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:42373)
0811 01:34:40.923015 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:40.923128 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":321,"threads_started":1}
I20260811 01:34:41.394229 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:41.393377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:48329)
0811 01:34:41.393879 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:41.393971 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":283,"threads_started":1}
I20260811 01:34:41.872664 8885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:41.871854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:51379)
0811 01:34:41.872388 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:41.872479 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":249,"threads_started":1}
I20260811 01:34:41.925237 8887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:41.924414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:40285)
0811 01:34:41.924929 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:41.925036 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":279,"threads_started":1}
I20260811 01:34:42.396246 8888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:42.395394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:42671)
0811 01:34:42.395958 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:42.396059 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":297,"threads_started":1}
I20260811 01:34:42.497020 8889 raft_consensus.cc:482] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:42.497283 8889 raft_consensus.cc:504] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2ec7788b654ab49a78bfa02c68aa7b" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 46581 } } peers { permanent_uuid: "e386f8288f9e4846a77587b9fdc0a606" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 46093 } } peers { permanent_uuid: "b04fc2c167014e449983290ecefcae01" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46419 } }
I20260811 01:34:42.498013 8889 leader_election.cc:288] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581), b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419)
W20260811 01:34:42.499089 8414 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2ec7788b654ab49a78bfa02c68aa7b (127.23.39.194:46581): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
W20260811 01:34:42.499313 8416 leader_election.cc:341] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b04fc2c167014e449983290ecefcae01 (127.23.39.195:46419): Not found: Tablet not found: dff1b20e4f5f4c66a9dd5d3eac1d2686
I20260811 01:34:42.499501 8416 leader_election.cc:302] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e386f8288f9e4846a77587b9fdc0a606; no voters: 3d2ec7788b654ab49a78bfa02c68aa7b, b04fc2c167014e449983290ecefcae01
I20260811 01:34:42.499835 8889 raft_consensus.cc:2726] T dff1b20e4f5f4c66a9dd5d3eac1d2686 P e386f8288f9e4846a77587b9fdc0a606 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:34:42.874704 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:42.873800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:35219)
0811 01:34:42.874384 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:42.874495 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":270,"threads_started":1}
I20260811 01:34:42.927281 8891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:42.926337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:45005)
0811 01:34:42.926936 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:42.927047 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":305,"threads_started":1}
I20260811 01:34:43.398226 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:43.397261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:41085)
0811 01:34:43.397825 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:43.397915 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":309,"threads_started":1}
I20260811 01:34:43.876593 8894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:43.875806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:37765)
0811 01:34:43.876313 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:43.876411 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":291,"threads_started":1}
I20260811 01:34:43.929356 8895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:43.928474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:41225)
0811 01:34:43.929034 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:43.929132 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":309,"threads_started":1}
I20260811 01:34:44.400275 8896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:44.399447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:41129)
0811 01:34:44.399988 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:44.400101 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":282,"threads_started":1}
I20260811 01:34:44.878835 8897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:44.877793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:54655)
0811 01:34:44.878504 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:44.878627 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":443,"threads_started":1}
I20260811 01:34:44.931229 8898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:44.930451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:41617)
0811 01:34:44.930929 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:44.931017 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":246,"threads_started":1}
I20260811 01:34:45.402374 8899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:45.401388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:42103)
0811 01:34:45.402005 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:45.402101 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":350,"threads_started":1}
I20260811 01:34:45.880650 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:45.879874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:44371)
0811 01:34:45.880358 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:45.880446 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":244,"threads_started":1}
I20260811 01:34:45.933521 8902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:45.932680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:52279)
0811 01:34:45.933215 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:45.933324 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":240,"threads_started":1}
I20260811 01:34:46.404428 8903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:46.403599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.194:45189)
0811 01:34:46.404113 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:46.404254 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":255,"threads_started":1}
I20260811 01:34:46.858777 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 8358
I20260811 01:34:46.880633 8904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:46.860445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48680 (local address 127.23.39.193:46093)
0811 01:34:46.861102 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:46.861112 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:46.861148 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:34:46.861238 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:46.861248 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:46.861550 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:46.861869 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:46.863480 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:46.864440 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:46.865675 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:46.866281 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:46.866379 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:46.874471 (+ 8092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:46.874489 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:46.874504 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:46.874543 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:46.877695 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:46.878657 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:46.878664 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:46.878666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:46.878820 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:46.879181 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:46.879185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:46.879187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:46.879591 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:46.879820 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:46.880123 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 01:34:46.880370 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":266,"threads_started":1}
I20260811 01:34:46.882018 8541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:46.882723 8905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:46.881674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.195:47907)
0811 01:34:46.882244 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:46.882450 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":227,"threads_started":1}
I20260811 01:34:46.975445 8908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:46.974316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42621 (local address 127.23.39.193:56329)
0811 01:34:46.974904 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:46.975135 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:42621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":269,"threads_started":1}
I20260811 01:34:46.975714 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 8358
I20260811 01:34:46.997375 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 8552
I20260811 01:34:47.011725 8909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:46.998372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38702 (local address 127.23.39.194:46581)
0811 01:34:46.998888 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:46.998892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:46.998910 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:34:46.998967 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:46.998971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:46.999032 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:46.999129 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:47.000826 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:47.001642 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:47.003007 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:47.003479 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:47.003574 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:47.006347 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:47.006352 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:47.006356 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:47.006391 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:47.009153 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:47.009822 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:47.009826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:47.009828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:47.009949 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:47.010418 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:47.010421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:47.010423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:47.010695 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:47.010913 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:47.011179 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 01:34:47.011408 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":314,"threads_started":1}
I20260811 01:34:47.012535 8691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:47.098467 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 8552
I20260811 01:34:47.120085 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 8699
I20260811 01:34:47.134613 8911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:47.121048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47974 (local address 127.23.39.195:46419)
0811 01:34:47.121677 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:47.121682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:47.121698 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:34:47.121753 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:47.121756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:47.121822 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:47.121944 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:47.123475 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:47.124263 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:47.125485 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:47.125926 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:47.126062 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:47.128962 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:47.128967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:47.128971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:47.129005 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:47.131771 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:47.132530 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:47.132535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:47.132539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:47.132694 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:47.133068 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:47.133073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:47.133076 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:47.133363 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:47.133653 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:47.133944 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 01:34:47.134227 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":309,"threads_started":1}
I20260811 01:34:47.135412 8836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:47.222764 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 8699
2026-08-11T01:34:47Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24939 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:34:47 dist-test-slave-9jjr krb5kdc[8916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:34:47 dist-test-slave-9jjr krb5kdc[8916](info): set up 2 sockets
Aug 11 01:34:47 dist-test-slave-9jjr krb5kdc[8916](info): commencing operation
krb5kdc: starting...
W20260811 01:34:48.437367 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.008s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:34:48 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:34:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:34:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:34:48.770036 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:49.136665 8933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:49.137007 8933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:49.137181 8933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:49.144873 8933 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:34:49.144992 8933 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:34:49.145068 8933 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:34:49.145150 8933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:34:49.145282 8933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:49.145427 8933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:49.145499 8933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:34:49.145581 8933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:34:49.156172 8933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:49.157603 8933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:49.159039 8933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:49.172207 8942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:49.172237 8940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:49.172544 8933 server_base.cc:1034] running on GCE node
W20260811 01:34:49.173241 8939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:49.174351 8933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:49.175881 8933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:49.177124 8933 hybrid_clock.cc:648] HybridClock initialized: now 1786412089177055 us; error 35 us; skew 500 ppm
I20260811 01:34:49.177501 8933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:49 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412089, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:49.180867 8933 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:34:49.182492 8933 webserver.cc:460] Webserver started at http://127.23.39.254:36783/ using document root <none> and password file <none>
I20260811 01:34:49.183244 8933 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:49.183362 8933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:49.183696 8933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:49.186885 8933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "249079e9faad4d6990286334f85d591b"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "27d72cf4512d36a86f5822229054532e"
server_key_iv: "661af7bc8c504eddf53044d43585d964"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.187709 8933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "249079e9faad4d6990286334f85d591b"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "27d72cf4512d36a86f5822229054532e"
server_key_iv: "661af7bc8c504eddf53044d43585d964"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.193356 8933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:34:49.197041 8949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:49.198611 8933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:49.198814 8933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "249079e9faad4d6990286334f85d591b"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "27d72cf4512d36a86f5822229054532e"
server_key_iv: "661af7bc8c504eddf53044d43585d964"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.199043 8933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:49.230767 8933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:49.235354 8933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:49.235666 8933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:49.256299 8933 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39889
I20260811 01:34:49.256325 9009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39889 every 8 connection(s)
I20260811 01:34:49.257737 8933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:34:49.262058 9010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:49.263360 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 8933
I20260811 01:34:49.263586 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:34:49.264241 23711 external_mini_cluster.cc:1428] Setting key 0dfd06de7b071c8245720808ba7e7904
I20260811 01:34:49.277123 9010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap starting.
Aug 11 01:34:49 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:49.281029 9010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:49.282387 9010 log.cc:824] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:49.285602 9010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: No bootstrap required, opened a new log
I20260811 01:34:49.288707 9013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:49.266348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.23.39.254:39889)
0811 01:34:49.267207 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:49.267219 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:49.267264 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:34:49.268896 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:49.268921 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:49.269332 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:49.269680 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:49.271615 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.272912 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.274985 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.275777 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.275910 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:49.280817 (+ 4907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:49.280826 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:49.280841 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:49.280882 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:49.284304 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:49.285117 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:49.285123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:49.285134 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:49.285328 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:49.285767 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:49.285771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:49.285773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:49.286400 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:49.286734 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:49.287177 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 01:34:49.287652 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":400,"threads_started":1}
I20260811 01:34:49.294092 9010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:34:49.294674 9010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:49.294814 9010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249079e9faad4d6990286334f85d591b, State: Initialized, Role: FOLLOWER
I20260811 01:34:49.295473 9010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:34:49.295692 9010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:34:49.295794 9010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:34:49.295923 9010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:49.298575 9010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:34:49.299084 9010 leader_election.cc:302] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 249079e9faad4d6990286334f85d591b; no voters:
I20260811 01:34:49.299743 9010 leader_election.cc:288] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:34:49.299908 9016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:49.300673 9016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 LEADER]: Becoming Leader. State: Replica: 249079e9faad4d6990286334f85d591b, State: Running, Role: LEADER
I20260811 01:34:49.301225 9016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:34:49.302099 9010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:34:49.304119 9018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 249079e9faad4d6990286334f85d591b. Latest consensus state: current_term: 1 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:34:49.304526 9018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:49.305667 9017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:34:49.306115 9017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:34:49.309762 9021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:34:49.315698 9021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:34:49.325963 9021 catalog_manager.cc:1347] Generated new cluster ID: 275da7d01d4a4c63868fecc685a0eece
I20260811 01:34:49.326174 9021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:34:49.334321 9021 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:34:49.335703 9021 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:34:49.352344 9021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Generated new TSK 0
I20260811 01:34:49.353408 9021 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:34:49.451419 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:49.816200 9043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:49.816504 9043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:49.816663 9043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:49.824390 9043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:49.824525 9043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:49.824740 9043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:34:49.834915 9043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:49.836388 9043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:49.837786 9043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:49.851691 9048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:49.851744 9050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:49.852039 9052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:49.853434 9043 server_base.cc:1034] running on GCE node
I20260811 01:34:49.854292 9043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:49.855412 9043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:49.856642 9043 hybrid_clock.cc:648] HybridClock initialized: now 1786412089856579 us; error 53 us; skew 500 ppm
I20260811 01:34:49.857021 9043 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:49 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412089, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:49.860633 9043 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:34:49.862278 9043 webserver.cc:460] Webserver started at http://127.23.39.193:34687/ using document root <none> and password file <none>
I20260811 01:34:49.862993 9043 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:49.863117 9043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:49.863438 9043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:49.866743 9043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "c711d0d51514470ab76feb1c015926cf"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "af80da351e40471601d5c60668bfddbd"
server_key_iv: "a192a33a4e761fb3204716946dea6a74"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.867561 9043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "c711d0d51514470ab76feb1c015926cf"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "af80da351e40471601d5c60668bfddbd"
server_key_iv: "a192a33a4e761fb3204716946dea6a74"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.873337 9043 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:34:49.877363 9061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:49.878916 9043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:34:49.879117 9043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "c711d0d51514470ab76feb1c015926cf"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "af80da351e40471601d5c60668bfddbd"
server_key_iv: "a192a33a4e761fb3204716946dea6a74"
server_key_version: "encryptionkey@0"
I20260811 01:34:49.879345 9043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:49.894490 9043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:49.899222 9043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:49.899560 9043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:49.900672 9043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:49.902196 9043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:49.902273 9043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:49.902444 9043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:49.902501 9043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:49.938597 9043 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:40927
I20260811 01:34:49.938640 9187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:40927 every 8 connection(s)
I20260811 01:34:49.939972 9043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:34:49.948357 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9043
I20260811 01:34:49.948585 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:34:49.949370 23711 external_mini_cluster.cc:1428] Setting key 85aaf01f346a6d3c2bffec2c4295f797
Aug 11 01:34:49 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412089, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:49.964090 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:49.942697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:42599 (local address 127.23.39.254:39889)
0811 01:34:49.943174 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:49.943179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:49.944025 (+ 846us) server_negotiation.cc:407] Connection header received
0811 01:34:49.945926 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:49.945931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:49.946021 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:49.946155 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:49.947729 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.948893 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.950870 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.951377 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.951525 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:49.956189 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:49.956200 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:49.956207 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:49.956260 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:49.960045 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:49.961138 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:49.961146 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:49.961152 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:49.961324 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:49.961855 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:49.961862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:49.961868 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:49.962308 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:49.962477 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:49.963303 (+ 826us) server_negotiation.cc:299] Negotiation successful
0811 01:34:49.963592 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":256,"threads_started":1}
I20260811 01:34:49.964864 9192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:49.943132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:42599)
0811 01:34:49.943857 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:49.943905 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:49.945651 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:49.946426 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:49.946435 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:49.946968 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:49.947549 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:49.947567 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.949063 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.949068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:49.950728 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:49.950744 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:49.951653 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:49.951662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:49.952005 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:49.952833 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:49.952875 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:49.955898 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:49.960254 (+ 4356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:49.960263 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:49.960278 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:49.960975 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:49.961480 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:49.961485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:49.961487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:49.961721 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:49.962477 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:49.962485 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:49.962866 (+ 381us) client_negotiation.cc:769] Sending connection context
0811 01:34:49.963151 (+ 285us) client_negotiation.cc:240] Negotiation successful
0811 01:34:49.963633 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":283,"threads_started":1}
I20260811 01:34:49.966694 9188 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:34:49.967060 9188 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:49.967865 9188 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:34:49.970044 8972 ts_manager.cc:194] Registered new tserver with Master: c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927)
I20260811 01:34:49.971550 8972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:42599
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:34:50.021726 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:50.387288 9196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:50.387674 9196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:50.387863 9196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:50.395370 9196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:50.395490 9196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:50.395671 9196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:34:50.405759 9196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:50.407126 9196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:50.408489 9196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:50.422683 9201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:50.422700 9202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:50.423182 9204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:50.424067 9196 server_base.cc:1034] running on GCE node
I20260811 01:34:50.424712 9196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:50.425697 9196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:50.426916 9196 hybrid_clock.cc:648] HybridClock initialized: now 1786412090426860 us; error 46 us; skew 500 ppm
I20260811 01:34:50.427273 9196 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:50 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412090, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:50.430645 9196 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:34:50.432345 9196 webserver.cc:460] Webserver started at http://127.23.39.194:35949/ using document root <none> and password file <none>
I20260811 01:34:50.433074 9196 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:50.433224 9196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:50.433540 9196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:50.436832 9196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "798c6549c8f1444ab7ea6f204a968fa0"
format_stamp: "Formatted at 2026-08-11 01:34:50 on dist-test-slave-9jjr"
server_key: "8f52b5349d4f38fb098d0e62d8b31a5d"
server_key_iv: "de24d2699e115ba94417fd56f1657ccc"
server_key_version: "encryptionkey@0"
I20260811 01:34:50.437671 9196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "798c6549c8f1444ab7ea6f204a968fa0"
format_stamp: "Formatted at 2026-08-11 01:34:50 on dist-test-slave-9jjr"
server_key: "8f52b5349d4f38fb098d0e62d8b31a5d"
server_key_iv: "de24d2699e115ba94417fd56f1657ccc"
server_key_version: "encryptionkey@0"
I20260811 01:34:50.443293 9196 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260811 01:34:50.447470 9213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:50.449081 9196 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 01:34:50.449294 9196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "798c6549c8f1444ab7ea6f204a968fa0"
format_stamp: "Formatted at 2026-08-11 01:34:50 on dist-test-slave-9jjr"
server_key: "8f52b5349d4f38fb098d0e62d8b31a5d"
server_key_iv: "de24d2699e115ba94417fd56f1657ccc"
server_key_version: "encryptionkey@0"
I20260811 01:34:50.449529 9196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:50.466665 9196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:50.472050 9196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:50.472409 9196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:50.473539 9196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:50.475091 9196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:50.475206 9196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:50.475363 9196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:50.475432 9196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:50.510275 9196 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:37875
I20260811 01:34:50.510387 9338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:37875 every 8 connection(s)
I20260811 01:34:50.511744 9196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:34:50.514475 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9196
I20260811 01:34:50.514674 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:34:50.515280 23711 external_mini_cluster.cc:1428] Setting key a5789f1eb76512d123a72448f2993077
Aug 11 01:34:50 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412090, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:50.535326 9341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:50.514394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:42429 (local address 127.23.39.254:39889)
0811 01:34:50.514891 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:50.514895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:50.516168 (+ 1273us) server_negotiation.cc:407] Connection header received
0811 01:34:50.518307 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:50.518316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:50.518408 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:50.518529 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:50.520106 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:50.521279 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:50.523091 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:50.523856 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:50.524007 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:50.528215 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:50.528225 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:50.528232 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:50.528285 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:50.531687 (+ 3402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:50.532795 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:50.532799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:50.532802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:50.532953 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:50.533469 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:50.533472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:50.533474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:50.533745 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:50.533855 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:50.534859 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0811 01:34:50.535041 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":275,"threads_started":1}
I20260811 01:34:50.537097 9342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:50.515052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:42429)
0811 01:34:50.515882 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:50.515967 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:50.517975 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:50.518737 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:50.518745 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:50.519328 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:50.519923 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:50.519945 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:50.521527 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:50.521533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:50.522924 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:50.522937 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:50.524126 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:50.524133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:50.524357 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:50.525182 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:50.525207 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:50.527908 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:50.531872 (+ 3964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:50.531883 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:50.531905 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:50.532644 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:50.533067 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:50.533072 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:50.533075 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:50.533353 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:50.533873 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:50.533884 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:50.534429 (+ 545us) client_negotiation.cc:769] Sending connection context
0811 01:34:50.534766 (+ 337us) client_negotiation.cc:240] Negotiation successful
0811 01:34:50.535451 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":342,"threads_started":1}
I20260811 01:34:50.538753 9339 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:34:50.539106 9339 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:50.539937 9339 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:34:50.541568 8972 ts_manager.cc:194] Registered new tserver with Master: 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875)
I20260811 01:34:50.542506 8972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:42429
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:34:50.589663 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:34:50.965929 9345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:34:50.966320 9345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:34:50.966440 9345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:34:50.974406 9345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:34:50.974529 9345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:34:50.974732 9345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:34:50.974798 9188 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:34:50.985728 9345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:34:50.987156 9345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:34:50.988566 9345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:34:51.002456 9350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:51.002493 9351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:34:51.002518 9353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:34:51.004082 9345 server_base.cc:1034] running on GCE node
I20260811 01:34:51.004870 9345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:34:51.005832 9345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:34:51.007082 9345 hybrid_clock.cc:648] HybridClock initialized: now 1786412091007024 us; error 51 us; skew 500 ppm
I20260811 01:34:51.007479 9345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:34:51 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412091, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:34:51.010848 9345 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:34:51.012480 9345 webserver.cc:460] Webserver started at http://127.23.39.195:35709/ using document root <none> and password file <none>
I20260811 01:34:51.013182 9345 fs_manager.cc:359] Metadata directory not provided
I20260811 01:34:51.013314 9345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:34:51.013643 9345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:34:51.016993 9345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
format_stamp: "Formatted at 2026-08-11 01:34:51 on dist-test-slave-9jjr"
server_key: "f5b7d9884f3a76db2a1ded1ed754cc5f"
server_key_iv: "6296d0b877b9f82389fd8e4c2aba089f"
server_key_version: "encryptionkey@0"
I20260811 01:34:51.017843 9345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
format_stamp: "Formatted at 2026-08-11 01:34:51 on dist-test-slave-9jjr"
server_key: "f5b7d9884f3a76db2a1ded1ed754cc5f"
server_key_iv: "6296d0b877b9f82389fd8e4c2aba089f"
server_key_version: "encryptionkey@0"
I20260811 01:34:51.023645 9345 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:34:51.027469 9360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:51.028946 9345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:34:51.029150 9345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
format_stamp: "Formatted at 2026-08-11 01:34:51 on dist-test-slave-9jjr"
server_key: "f5b7d9884f3a76db2a1ded1ed754cc5f"
server_key_iv: "6296d0b877b9f82389fd8e4c2aba089f"
server_key_version: "encryptionkey@0"
I20260811 01:34:51.029356 9345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:34:51.069767 9345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:34:51.074559 9345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:34:51.074896 9345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:34:51.076031 9345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:34:51.077505 9345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:34:51.077584 9345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:51.077672 9345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:34:51.077716 9345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:34:51.113814 9345 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:33869
I20260811 01:34:51.113905 9490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:33869 every 8 connection(s)
I20260811 01:34:51.115257 9345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:34:51.116314 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9345
I20260811 01:34:51.116524 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:34:51.117134 23711 external_mini_cluster.cc:1428] Setting key df9df3a265105cf10037c734fd7ee675
Aug 11 01:34:51 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412091, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:34:51.139443 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.118427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:49041 (local address 127.23.39.254:39889)
0811 01:34:51.118931 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.118937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.120139 (+ 1202us) server_negotiation.cc:407] Connection header received
0811 01:34:51.122276 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.122280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.122356 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.122474 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:51.124382 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.125220 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.127410 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.127833 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.127947 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.132485 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:51.132494 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:51.132499 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:51.132545 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:51.135979 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.136905 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.136910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.136912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.137054 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.137582 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.137586 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.137588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.137891 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:51.138025 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.138896 (+ 871us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.139096 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":239,"threads_started":1}
I20260811 01:34:51.140470 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.119064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:49041)
0811 01:34:51.119956 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.120018 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.121853 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.122837 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.122847 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.123516 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:34:51.124162 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.124181 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.125427 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.125431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.127237 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.127253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.128120 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.128126 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.128351 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.129231 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:34:51.129260 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:34:51.132248 (+ 2988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:34:51.136178 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:51.136186 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:51.136201 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:51.136763 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:51.137225 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:34:51.137229 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:34:51.137231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:34:51.137461 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:34:51.138021 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:34:51.138027 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:34:51.138511 (+ 484us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.138759 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.139213 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":408,"threads_started":1}
I20260811 01:34:51.142072 9491 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:34:51.142498 9491 heartbeater.cc:464] Registering TS with master...
I20260811 01:34:51.143386 9491 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:34:51.145175 8972 ts_manager.cc:194] Registered new tserver with Master: 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
I20260811 01:34:51.146240 8972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:49041
I20260811 01:34:51.146409 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:34:51.165474 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.151413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.23.39.254:39889)
0811 01:34:51.151693 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.151701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.152037 (+ 336us) server_negotiation.cc:407] Connection header received
0811 01:34:51.152308 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.152313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.152380 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.152483 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:51.154205 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.154935 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.156388 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.156806 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.156939 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.159628 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:51.159634 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:51.159637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:51.159674 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:51.162562 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.163330 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.163335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.163338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.163472 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.163879 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.163887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.163890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.164262 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:51.164525 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.164862 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.165139 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 01:34:51.170320 8972 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:34:51.177385 8972 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:34:51.204252 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.190823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:33869 (local address 127.0.0.1:47746)
0811 01:34:51.191632 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.191677 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.191874 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.193282 (+ 1408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.193293 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.193334 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:51.193814 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.193830 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.196831 (+ 3001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.196840 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.199966 (+ 3126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.199994 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.202701 (+ 2707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.202711 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.203103 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.203194 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.203349 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.203586 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":358,"threads_started":1}
I20260811 01:34:51.205701 9506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.191074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47746 (local address 127.23.39.195:33869)
0811 01:34:51.192563 (+ 1489us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.192572 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.192604 (+ 32us) server_negotiation.cc:407] Connection header received
0811 01:34:51.192702 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.192709 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.192985 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.194052 (+ 1067us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:51.194431 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.196608 (+ 2177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.200310 (+ 3702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.202402 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.204478 (+ 2076us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.204845 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.204941 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.205207 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1306,"thread_start_us":1154,"threads_started":1}
I20260811 01:34:51.210057 9419 tablet_service.cc:1467] Processing CreateTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 (DEFAULT_TABLE table=test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:51.211845 9419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4939eb876dcc4355b78bf6ef328fcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:51.212675 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.192665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.23.39.194:37875)
0811 01:34:51.203789 (+ 11124us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.203802 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.204828 (+ 1026us) server_negotiation.cc:407] Connection header received
0811 01:34:51.204951 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.204962 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.205268 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.205500 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:51.206227 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.207815 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.209634 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.211288 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.211456 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.211684 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.212147 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.212324 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10902,"thread_start_us":10787,"threads_started":1}
I20260811 01:34:51.212673 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.192095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:37875 (local address 127.0.0.1:54242)
0811 01:34:51.204537 (+ 12442us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.204556 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.204686 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.205762 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.205767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.205795 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:51.206007 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.206017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.208040 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.208049 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.209343 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.209408 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.211502 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.211508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.211860 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.211908 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.212022 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.212271 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12339,"mutex_wait_us":48,"thread_start_us":9515,"threads_started":1}
I20260811 01:34:51.215046 9510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.191621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:46532)
0811 01:34:51.201269 (+ 9648us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.201302 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.201495 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.207303 (+ 5808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.207309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.207338 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:51.207722 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.207738 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.209657 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.209662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.211944 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.211961 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.214077 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.214084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.214306 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.214339 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.214443 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.214583 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9434,"mutex_wait_us":30,"thread_start_us":14867,"threads_started":1}
I20260811 01:34:51.215931 9508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.191829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.23.39.193:40927)
0811 01:34:51.205048 (+ 13219us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.205058 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.205088 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:34:51.206785 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.206795 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.207081 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.207289 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:51.207949 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.209482 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.212143 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.213827 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.213996 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.214271 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.215431 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.215626 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12336,"thread_start_us":14147,"threads_started":1}
I20260811 01:34:51.217442 9268 tablet_service.cc:1467] Processing CreateTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 (DEFAULT_TABLE table=test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:51.219000 9268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4939eb876dcc4355b78bf6ef328fcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:51.219192 9115 tablet_service.cc:1467] Processing CreateTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 (DEFAULT_TABLE table=test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:34:51.220407 9115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4939eb876dcc4355b78bf6ef328fcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:34:51.229491 9512 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Bootstrap starting.
I20260811 01:34:51.233300 9512 tablet_bootstrap.cc:654] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:51.233325 9513 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Bootstrap starting.
I20260811 01:34:51.235010 9512 log.cc:824] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:51.236642 9514 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Bootstrap starting.
I20260811 01:34:51.238260 9513 tablet_bootstrap.cc:654] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:51.238919 9512 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: No bootstrap required, opened a new log
I20260811 01:34:51.239264 9512 ts_tablet_manager.cc:1397] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 01:34:51.239658 9513 log.cc:824] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:51.239986 9514 tablet_bootstrap.cc:654] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Neither blocks nor log segments found. Creating new log.
I20260811 01:34:51.241308 9514 log.cc:824] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:34:51.243220 9513 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: No bootstrap required, opened a new log
I20260811 01:34:51.243517 9513 ts_tablet_manager.cc:1397] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 01:34:51.243871 9514 tablet_bootstrap.cc:492] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: No bootstrap required, opened a new log
I20260811 01:34:51.244123 9514 ts_tablet_manager.cc:1397] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 01:34:51.251732 9512 raft_consensus.cc:348] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.252295 9512 raft_consensus.cc:374] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:51.252408 9512 raft_consensus.cc:729] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c44a1cefa8b48eebe63a8c32fc1b77e, State: Initialized, Role: FOLLOWER
I20260811 01:34:51.253127 9512 consensus_queue.cc:260] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.253232 9514 raft_consensus.cc:348] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.253701 9514 raft_consensus.cc:374] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:51.253882 9514 raft_consensus.cc:729] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 798c6549c8f1444ab7ea6f204a968fa0, State: Initialized, Role: FOLLOWER
I20260811 01:34:51.254566 9514 consensus_queue.cc:260] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.254799 9491 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:34:51.255627 9512 ts_tablet_manager.cc:1428] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Time spent starting tablet: real 0.016s user 0.007s sys 0.008s
I20260811 01:34:51.256271 9514 ts_tablet_manager.cc:1428] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260811 01:34:51.256414 9339 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:34:51.257802 9513 raft_consensus.cc:348] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.258330 9513 raft_consensus.cc:374] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:34:51.258451 9513 raft_consensus.cc:729] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711d0d51514470ab76feb1c015926cf, State: Initialized, Role: FOLLOWER
I20260811 01:34:51.259009 9513 consensus_queue.cc:260] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
W20260811 01:34:51.263818 9340 tablet.cc:2369] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:51.264955 9513 ts_tablet_manager.cc:1428] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Time spent starting tablet: real 0.021s user 0.016s sys 0.003s
W20260811 01:34:51.367122 9492 tablet.cc:2369] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:51.429306 9520 raft_consensus.cc:482] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:34:51.429694 9520 raft_consensus.cc:504] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.431522 9520 leader_election.cc:288] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869), c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927)
I20260811 01:34:51.439199 9508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.432282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:59241 (local address 127.23.39.193:40927)
0811 01:34:51.432547 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.432557 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.433610 (+ 1053us) server_negotiation.cc:407] Connection header received
0811 01:34:51.433828 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.433834 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.433902 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.433999 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:51.434719 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.435522 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.437298 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.438111 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.438315 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.438405 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.438750 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.438890 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:34:51.439226 9506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.432192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:51347 (local address 127.23.39.195:33869)
0811 01:34:51.432455 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.432463 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.433403 (+ 940us) server_negotiation.cc:407] Connection header received
0811 01:34:51.433653 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.433658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.433765 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.433867 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:34:51.434560 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.435369 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.437325 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.438108 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.438329 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.438406 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.438763 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.438904 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:34:51.439441 9522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.432149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.23.39.194:59241)
0811 01:34:51.433500 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.433516 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.433660 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.434021 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.434026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.434064 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:51.434560 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.434571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.435665 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.435669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.437127 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.437139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.438364 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.438371 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.438543 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.438617 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.438723 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.438907 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"mutex_wait_us":89,"thread_start_us":606,"threads_started":1}
I20260811 01:34:51.439476 9523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.432083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:33869 (local address 127.23.39.194:51347)
0811 01:34:51.433245 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0811 01:34:51.433262 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:34:51.433504 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:34:51.433886 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:34:51.433890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:34:51.433913 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:34:51.434364 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.434374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.435522 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.435529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.437133 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:34:51.437148 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.438398 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.438404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:34:51.438577 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.438620 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 01:34:51.438734 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 01:34:51.438932 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1007,"mutex_wait_us":70,"thread_start_us":846,"threads_started":1}
I20260811 01:34:51.440507 9441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4939eb876dcc4355b78bf6ef328fcd03" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" is_pre_election: true
I20260811 01:34:51.440503 9138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4939eb876dcc4355b78bf6ef328fcd03" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711d0d51514470ab76feb1c015926cf" is_pre_election: true
I20260811 01:34:51.441016 9441 raft_consensus.cc:2454] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 0.
I20260811 01:34:51.441016 9138 raft_consensus.cc:2454] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 0.
I20260811 01:34:51.441720 9215 leader_election.cc:302] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0, c711d0d51514470ab76feb1c015926cf; no voters:
I20260811 01:34:51.442176 9520 raft_consensus.cc:2781] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:34:51.442337 9520 raft_consensus.cc:482] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:34:51.442449 9520 raft_consensus.cc:3037] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:34:51.442867 9189 tablet.cc:2369] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:34:51.444729 9520 raft_consensus.cc:504] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.445428 9520 leader_election.cc:288] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 election: Requested vote from peers 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869), c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927)
I20260811 01:34:51.445834 9441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4939eb876dcc4355b78bf6ef328fcd03" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
I20260811 01:34:51.445950 9138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4939eb876dcc4355b78bf6ef328fcd03" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711d0d51514470ab76feb1c015926cf"
I20260811 01:34:51.446056 9441 raft_consensus.cc:3037] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:51.446255 9138 raft_consensus.cc:3037] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:34:51.448608 9441 raft_consensus.cc:2454] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 1.
I20260811 01:34:51.449007 9138 raft_consensus.cc:2454] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 1.
I20260811 01:34:51.449064 9215 leader_election.cc:302] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0; no voters:
I20260811 01:34:51.449476 9520 raft_consensus.cc:2781] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:34:51.449975 9520 raft_consensus.cc:686] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 798c6549c8f1444ab7ea6f204a968fa0, State: Running, Role: LEADER
I20260811 01:34:51.450565 9520 consensus_queue.cc:237] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } }
I20260811 01:34:51.455443 8971 catalog_manager.cc:5495] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "798c6549c8f1444ab7ea6f204a968fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } health_report { overall_health: UNKNOWN } } }
I20260811 01:34:51.521281 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.514929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54258 (local address 127.23.39.194:37875)
0811 01:34:51.515120 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.515126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.515221 (+ 95us) server_negotiation.cc:407] Connection header received
0811 01:34:51.515417 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.515422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.515514 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.515677 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:34:51.516021 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.517096 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.518700 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.519417 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.519542 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.520035 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:34:51.520678 (+ 643us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:34:51.520816 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.520887 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.520973 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:34:51.529708 9441 raft_consensus.cc:1261] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Refusing update from remote peer 798c6549c8f1444ab7ea6f204a968fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:51.529717 9138 raft_consensus.cc:1261] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Refusing update from remote peer 798c6549c8f1444ab7ea6f204a968fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:34:51.530753 9520 consensus_queue.cc:1035] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:51.531040 9524 consensus_queue.cc:1035] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:34:51.561141 8971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:51.561460 8971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:34:51.565415 8971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Sending DeleteTablet for 3 replicas of tablet 4939eb876dcc4355b78bf6ef328fcd03
I20260811 01:34:51.566821 9115 tablet_service.cc:1514] Processing DeleteTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:51 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:46532
I20260811 01:34:51.566821 9268 tablet_service.cc:1514] Processing DeleteTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:51 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:54242
I20260811 01:34:51.566900 9419 tablet_service.cc:1514] Processing DeleteTablet for tablet 4939eb876dcc4355b78bf6ef328fcd03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:34:51 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:47746
I20260811 01:34:51.568181 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9043
I20260811 01:34:51.582618 9541 tablet_replica.cc:330] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: stopping tablet replica
I20260811 01:34:51.583439 9541 raft_consensus.cc:2229] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:51.584263 9541 raft_consensus.cc:2258] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:51.587289 9541 ts_tablet_manager.cc:1905] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:51.595911 9541 ts_tablet_manager.cc:1918] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:51.596241 9541 log.cc:1196] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/4939eb876dcc4355b78bf6ef328fcd03
I20260811 01:34:51.596877 9541 ts_tablet_manager.cc:1939] T 4939eb876dcc4355b78bf6ef328fcd03 P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting consensus metadata
I20260811 01:34:51.599188 8953 catalog_manager.cc:4841] TS 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): tablet 4939eb876dcc4355b78bf6ef328fcd03 (table test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]) successfully deleted
I20260811 01:34:51.599845 9538 tablet_replica.cc:330] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: stopping tablet replica
I20260811 01:34:51.599830 9540 tablet_replica.cc:330] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: stopping tablet replica
I20260811 01:34:51.600332 9538 raft_consensus.cc:2229] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:34:51.600335 9540 raft_consensus.cc:2229] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:34:51.600984 9540 raft_consensus.cc:2258] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:51.601161 9538 raft_consensus.cc:2258] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:34:51.603616 9540 ts_tablet_manager.cc:1905] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:34:51.603683 9538 ts_tablet_manager.cc:1905] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 01:34:51 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:34:51.611178 9540 ts_tablet_manager.cc:1918] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:51.611495 9540 log.cc:1196] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/4939eb876dcc4355b78bf6ef328fcd03
I20260811 01:34:51.611971 9538 ts_tablet_manager.cc:1918] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:34:51.612337 9538 log.cc:1196] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/4939eb876dcc4355b78bf6ef328fcd03
I20260811 01:34:51.612524 9540 ts_tablet_manager.cc:1939] T 4939eb876dcc4355b78bf6ef328fcd03 P c711d0d51514470ab76feb1c015926cf: Deleting consensus metadata
I20260811 01:34:51.612980 9538 ts_tablet_manager.cc:1939] T 4939eb876dcc4355b78bf6ef328fcd03 P 798c6549c8f1444ab7ea6f204a968fa0: Deleting consensus metadata
I20260811 01:34:51.614784 8953 catalog_manager.cc:4841] TS 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): tablet 4939eb876dcc4355b78bf6ef328fcd03 (table test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]) successfully deleted
I20260811 01:34:51.614786 8954 catalog_manager.cc:4841] TS c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927): tablet 4939eb876dcc4355b78bf6ef328fcd03 (table test-table [id=4d8c8c278fa84532a3b09cb4cff8949a]) successfully deleted
I20260811 01:34:51.615939 9508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.569644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.23.39.193:40927)
0811 01:34:51.569870 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.569880 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.592303 (+ 22423us) server_negotiation.cc:407] Connection header received
0811 01:34:51.592933 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.592941 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.593033 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.593111 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:51.595347 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.596604 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.600310 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.601064 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.601170 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.607432 (+ 6262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:51.607449 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:51.607467 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:51.607524 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:51.611951 (+ 4427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.613060 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.613071 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.613075 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.613279 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.613781 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.613787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.613790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.614336 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:51.614634 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.615297 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.615540 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:34:51.617386 9183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:51.709398 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9043
I20260811 01:34:51.732129 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9196
Aug 11 01:34:51 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:34:51.751252 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.732986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54266 (local address 127.23.39.194:37875)
0811 01:34:51.733176 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.733183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.733486 (+ 303us) server_negotiation.cc:407] Connection header received
0811 01:34:51.733674 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.733679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.733758 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.733847 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:51.735608 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.736473 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.738570 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.739015 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.739125 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.744745 (+ 5620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:51.744763 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:51.744780 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:51.744832 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:51.747990 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.748898 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.748906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.748908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.749061 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.749534 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.749538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.749540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.749928 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:51.750325 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.750630 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.750879 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 01:34:51.752074 9333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:51.871877 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9196
I20260811 01:34:51.892181 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9345
Aug 11 01:34:51 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:34:51.913995 9506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:34:51.892907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47756 (local address 127.23.39.195:33869)
0811 01:34:51.893120 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:34:51.893126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:34:51.893265 (+ 139us) server_negotiation.cc:407] Connection header received
0811 01:34:51.893469 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:34:51.893475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:34:51.893563 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:34:51.893669 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:34:51.895131 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.895873 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.897355 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:34:51.897777 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:34:51.897914 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:34:51.907939 (+ 10025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:34:51.907959 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:34:51.907975 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:34:51.908018 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:34:51.910754 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.911725 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.911734 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.911737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.911906 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:34:51.912338 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:34:51.912344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:34:51.912352 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:34:51.912738 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:34:51.913045 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 01:34:51.913407 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 01:34:51.913660 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:34:51.914714 9485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:52.005643 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9345
I20260811 01:34:52.026280 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 8933
I20260811 01:34:52.027477 9004 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:34:52.139813 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 8933
I20260811 01:35:12.166028 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--webserver_interface=127.23.39.254
--webserver_port=36783
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:12.534864 9548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:12.535198 9548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:12.535374 9548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:12.543092 9548 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:35:12.543220 9548 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:35:12.543260 9548 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:35:12.543377 9548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:35:12.543457 9548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:12.543589 9548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:12.543663 9548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:35:12.543761 9548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:35:12.554636 9548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=36783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:12.556192 9548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:12.557623 9548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:12.584834 9555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:12.584805 9557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:12.584969 9554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:12.585170 9548 server_base.cc:1034] running on GCE node
I20260811 01:35:12.586539 9548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:12.588238 9548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:12.589522 9548 hybrid_clock.cc:648] HybridClock initialized: now 1786412112589452 us; error 43 us; skew 500 ppm
I20260811 01:35:12.589946 9548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:12 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412112, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:12.593739 9548 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:35:12.595628 9548 webserver.cc:460] Webserver started at http://127.23.39.254:36783/ using document root <none> and password file <none>
I20260811 01:35:12.596477 9548 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:12.596637 9548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:12.603205 9548 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 01:35:12.606784 9565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:12.608350 9548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:35:12.608587 9548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "249079e9faad4d6990286334f85d591b"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "27d72cf4512d36a86f5822229054532e"
server_key_iv: "661af7bc8c504eddf53044d43585d964"
server_key_version: "encryptionkey@0"
I20260811 01:35:12.609776 9548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:12.629681 9548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:12.634634 9548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:12.635005 9548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:12.656704 9627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39889 every 8 connection(s)
I20260811 01:35:12.656751 9548 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39889
I20260811 01:35:12.659552 9548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:35:12.660812 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9548
I20260811 01:35:12.662268 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:40927
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=34687
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:35:12.670183 9629 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:35:12.673945 9629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap starting.
I20260811 01:35:12.696300 9629 log.cc:824] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:12.709749 9629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:35:12.710553 9629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap complete.
I20260811 01:35:12.721026 9629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:12.722003 9629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249079e9faad4d6990286334f85d591b, State: Initialized, Role: FOLLOWER
I20260811 01:35:12.722731 9629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:12.723030 9629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:35:12.723209 9629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:35:12.723402 9629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 1 FOLLOWER]: Advancing to term 2
I20260811 01:35:12.727821 9629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:12.728498 9629 leader_election.cc:302] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 249079e9faad4d6990286334f85d591b; no voters:
I20260811 01:35:12.729278 9629 leader_election.cc:288] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 01:35:12.729429 9633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 01:35:12.730844 9633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 LEADER]: Becoming Leader. State: Replica: 249079e9faad4d6990286334f85d591b, State: Running, Role: LEADER
I20260811 01:35:12.731518 9633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:12.732095 9629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:35:12.734488 9634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:35:12.734992 9634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:12.739573 9635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 249079e9faad4d6990286334f85d591b. Latest consensus state: current_term: 2 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:35:12.740010 9635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:12.742784 9639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:35:12.752275 9639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:35:12.753867 9639 catalog_manager.cc:1259] Loaded cluster ID: 275da7d01d4a4c63868fecc685a0eece
I20260811 01:35:12.753985 9639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:35:12.758301 9639 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:35:12.759933 9639 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Loaded TSK: 0
I20260811 01:35:12.795612 9639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Generated new TSK 1
I20260811 01:35:12.796098 9639 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:35:13.052637 9631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:13.053009 9631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:13.053201 9631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:13.060894 9631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:13.061071 9631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:13.061280 9631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:35:13.072052 9631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:40927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=34687
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:13.073464 9631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:13.074891 9631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:13.090651 9657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:13.090669 9659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:13.091878 9656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:13.095883 9631 server_base.cc:1034] running on GCE node
I20260811 01:35:13.096573 9631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:13.097734 9631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:13.098964 9631 hybrid_clock.cc:648] HybridClock initialized: now 1786412113098894 us; error 62 us; skew 500 ppm
I20260811 01:35:13.099318 9631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:13 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412113, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:13.102777 9631 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:35:13.104614 9631 webserver.cc:460] Webserver started at http://127.23.39.193:34687/ using document root <none> and password file <none>
I20260811 01:35:13.105377 9631 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:13.105530 9631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:13.111555 9631 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260811 01:35:13.114601 9667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.116209 9631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 01:35:13.116391 9631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "c711d0d51514470ab76feb1c015926cf"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "af80da351e40471601d5c60668bfddbd"
server_key_iv: "a192a33a4e761fb3204716946dea6a74"
server_key_version: "encryptionkey@0"
I20260811 01:35:13.117411 9631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:13.148998 9631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:13.153723 9631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:13.153978 9631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:13.155085 9631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:13.156433 9631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:13.156520 9631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.156600 9631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:13.156658 9631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.191053 9631 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:40927
I20260811 01:35:13.191179 9792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:40927 every 8 connection(s)
I20260811 01:35:13.192526 9631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:35:13.200279 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9631
I20260811 01:35:13.200970 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:37875
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=35949
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:35:13 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412113, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:13.217658 9796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:13.195842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:49139)
0811 01:35:13.196742 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:13.196780 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:13.198647 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:13.200098 (+ 1451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:13.200113 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:13.200789 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:13.201418 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:13.201437 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.203141 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.203149 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:13.204452 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:13.204465 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.205514 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.205521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:13.205813 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:13.206576 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:13.206600 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:13.209087 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:13.212862 (+ 3775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:13.212873 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:13.212889 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:13.213385 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:13.213904 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:13.213911 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:13.213914 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:13.214247 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:13.215030 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:13.215038 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:13.215401 (+ 363us) client_negotiation.cc:769] Sending connection context
0811 01:35:13.215680 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 01:35:13.216297 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":384,"threads_started":1}
I20260811 01:35:13.217659 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:13.195631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:49139 (local address 127.23.39.254:39889)
0811 01:35:13.196385 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:13.196402 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:13.196923 (+ 521us) server_negotiation.cc:407] Connection header received
0811 01:35:13.199198 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:13.199211 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:13.199550 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:13.199953 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:13.201660 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.202946 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.204614 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.205263 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.205476 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:13.209388 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:13.209396 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:13.209412 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:13.209456 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:13.212647 (+ 3191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:13.213572 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:13.213580 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:13.213585 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:13.213773 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:13.214367 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:13.214373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:13.214378 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:13.214881 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:13.215095 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:13.215912 (+ 817us) server_negotiation.cc:299] Negotiation successful
0811 01:35:13.216306 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":298,"threads_started":1}
I20260811 01:35:13.220988 9793 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:35:13.221369 9793 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:13.222326 9793 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:35:13.224865 9589 ts_manager.cc:194] Registered new tserver with Master: c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927)
I20260811 01:35:13.227409 9589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:49139
W20260811 01:35:13.558648 9797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:13.558947 9797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:13.559106 9797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:13.566578 9797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:13.566695 9797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:13.566902 9797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:35:13.576776 9797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:37875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=35949
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:13.578117 9797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:13.579478 9797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:13.592767 9803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:13.592803 9802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:13.593370 9805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:13.598524 9797 server_base.cc:1034] running on GCE node
I20260811 01:35:13.599211 9797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:13.600185 9797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:13.601409 9797 hybrid_clock.cc:648] HybridClock initialized: now 1786412113601365 us; error 30 us; skew 500 ppm
I20260811 01:35:13.601783 9797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:13 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412113, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:13.605290 9797 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:35:13.606999 9797 webserver.cc:460] Webserver started at http://127.23.39.194:35949/ using document root <none> and password file <none>
I20260811 01:35:13.607694 9797 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:13.607812 9797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:13.613343 9797 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:35:13.616328 9812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.617647 9797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 01:35:13.617830 9797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "798c6549c8f1444ab7ea6f204a968fa0"
format_stamp: "Formatted at 2026-08-11 01:34:50 on dist-test-slave-9jjr"
server_key: "8f52b5349d4f38fb098d0e62d8b31a5d"
server_key_iv: "de24d2699e115ba94417fd56f1657ccc"
server_key_version: "encryptionkey@0"
I20260811 01:35:13.618885 9797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:13.631958 9797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:13.636991 9797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:13.637246 9797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:13.638341 9797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:13.639874 9797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:13.639974 9797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.640056 9797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:13.640112 9797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:13.677806 9797 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:37875
I20260811 01:35:13.677860 9938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:37875 every 8 connection(s)
I20260811 01:35:13.679687 9797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:35:13.686983 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9797
I20260811 01:35:13.687685 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:33869
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=35709
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 01:35:13 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412113, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:13.701732 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:13.682563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56901 (local address 127.23.39.254:39889)
0811 01:35:13.682746 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:13.682750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:13.684100 (+ 1350us) server_negotiation.cc:407] Connection header received
0811 01:35:13.686101 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:13.686107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:13.686285 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:13.686414 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:13.688284 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.689018 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.690801 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.691254 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.691401 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:13.695285 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:13.695291 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:13.695294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:13.695333 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:13.698081 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:13.698988 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:13.698995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:13.698998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:13.699150 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:13.699699 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:13.699703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:13.699705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:13.700043 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:13.700181 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:13.701243 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0811 01:35:13.701465 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:35:13.703564 9941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:13.683121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:56901)
0811 01:35:13.683923 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:13.683963 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:13.685796 (+ 1833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:13.686698 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:13.686708 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:13.687342 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:13.688073 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:13.688095 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.689201 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.689206 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:13.690620 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:13.690634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:13.691509 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:13.691516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:13.691777 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:13.692572 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:13.692596 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:13.694985 (+ 2389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:13.698314 (+ 3329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:13.698324 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:13.698345 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:13.698847 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:13.699282 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:13.699287 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:13.699290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:13.699542 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:13.700207 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:13.700216 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:13.700776 (+ 560us) client_negotiation.cc:769] Sending connection context
0811 01:35:13.701155 (+ 379us) client_negotiation.cc:240] Negotiation successful
0811 01:35:13.701822 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":321,"threads_started":1}
I20260811 01:35:13.705394 9939 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:35:13.705758 9939 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:13.706599 9939 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:35:13.708251 9589 ts_manager.cc:194] Registered new tserver with Master: 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875)
I20260811 01:35:13.709112 9589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:56901
W20260811 01:35:14.067484 9942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:14.067894 9942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:14.068092 9942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:14.076364 9942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:14.076536 9942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:14.076735 9942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:35:14.087360 9942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:33869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=35709
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:14.088820 9942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:14.090284 9942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:14.104761 9947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:14.104789 9948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:14.104734 9950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:14.105261 9942 server_base.cc:1034] running on GCE node
I20260811 01:35:14.106385 9942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:14.107379 9942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:14.108590 9942 hybrid_clock.cc:648] HybridClock initialized: now 1786412114108541 us; error 41 us; skew 500 ppm
I20260811 01:35:14.108882 9942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:14 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412114, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:14.112406 9942 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:35:14.114094 9942 webserver.cc:460] Webserver started at http://127.23.39.195:35709/ using document root <none> and password file <none>
I20260811 01:35:14.114967 9942 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:14.115099 9942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:14.120774 9942 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:35:14.123910 9959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:14.125273 9942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:35:14.125465 9942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
format_stamp: "Formatted at 2026-08-11 01:34:51 on dist-test-slave-9jjr"
server_key: "f5b7d9884f3a76db2a1ded1ed754cc5f"
server_key_iv: "6296d0b877b9f82389fd8e4c2aba089f"
server_key_version: "encryptionkey@0"
I20260811 01:35:14.126518 9942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:14.143836 9942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:14.148720 9942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:14.148983 9942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:14.150084 9942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:14.151525 9942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:14.151628 9942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:14.151711 9942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:14.151772 9942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:14.188184 9942 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:33869
I20260811 01:35:14.188303 10085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:33869 every 8 connection(s)
I20260811 01:35:14.189746 9942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:35:14.196043 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 9942
Aug 11 01:35:14 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412114, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:14.215389 10090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.197206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41860 (local address 127.23.39.254:39889)
0811 01:35:14.197748 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.197757 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.198011 (+ 254us) server_negotiation.cc:407] Connection header received
0811 01:35:14.198254 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.198258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.198324 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.198421 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.200834 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.202190 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.204322 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.205037 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.205143 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.208430 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.208435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.208439 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.208474 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.211824 (+ 3350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.212835 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.212840 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.212843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.213032 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.213540 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.213546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.213551 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.213968 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.214283 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.214715 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.214953 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":378,"thread_start_us":319,"threads_started":1}
I20260811 01:35:14.216684 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.192953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:39615 (local address 127.23.39.254:39889)
0811 01:35:14.193159 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.193165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.194999 (+ 1834us) server_negotiation.cc:407] Connection header received
0811 01:35:14.198642 (+ 3643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.198646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.198700 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.198774 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.201010 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.202190 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.204657 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.205208 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.205365 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.209197 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.209201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.209205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.209261 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.212585 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.213646 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.213650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.213652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.213829 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.214462 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.214468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.214471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.214909 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.215066 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.216049 (+ 983us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.216274 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":73}
I20260811 01:35:14.217844 10088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.193711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:39615)
0811 01:35:14.194820 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.194867 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.198333 (+ 3466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.199078 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.199092 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.199921 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:14.200831 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.200854 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.202399 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.202404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.204469 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.204482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.205471 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.205477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.205719 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.206586 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:14.206610 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:14.208963 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:14.212826 (+ 3863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:14.212838 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:14.212859 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:14.213518 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:14.213952 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:14.213957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:14.213961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:14.214345 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:14.215066 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:14.215075 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:14.215638 (+ 563us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.215910 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.216555 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":508,"threads_started":1}
I20260811 01:35:14.219317 10086 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39889
I20260811 01:35:14.219663 10086 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:14.220530 10086 heartbeater.cc:511] Master 127.23.39.254:39889 requested a full tablet report, sending...
I20260811 01:35:14.222093 9589 ts_manager.cc:194] Registered new tserver with Master: 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
I20260811 01:35:14.223124 9589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:39615
I20260811 01:35:14.231109 9793 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:35:14.231634 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:35:14.238693 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.232693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.23.39.254:39889)
0811 01:35:14.232873 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.232879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.233460 (+ 581us) server_negotiation.cc:407] Connection header received
0811 01:35:14.233648 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.233652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.233810 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.233937 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:35:14.234454 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.235225 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.236709 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.237153 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.237260 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.237758 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:35:14.238035 (+ 277us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 01:35:14.238496 (+ 461us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41864: token expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 01:35:14.238806 9795 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41864: token expired
W20260811 01:35:14.239460 9495 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.39.254:39889)
I20260811 01:35:14.252846 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.240079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41874 (local address 127.23.39.254:39889)
0811 01:35:14.240229 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.240234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.240250 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:35:14.240343 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.240346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.240415 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.240505 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.241914 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.242740 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.244218 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.244666 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.244765 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.247526 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.247531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.247534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.247565 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.250317 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.250996 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.251000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.251002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.251116 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.251495 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.251498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.251500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.251817 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.251997 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.252342 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.252510 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 01:35:14.256390 9589 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:35:14.263868 9589 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:35:14.287322 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.277588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39420 (local address 127.23.39.193:40927)
0811 01:35:14.278690 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.278699 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.278744 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:35:14.278852 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.278862 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.279137 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.280217 (+ 1080us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:14.280466 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.281836 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.284385 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.285989 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.286667 (+ 678us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.286887 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.286945 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.287071 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":926,"thread_start_us":795,"threads_started":1}
I20260811 01:35:14.287433 10099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.276815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39420)
0811 01:35:14.277618 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.277671 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.277939 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.279367 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.279374 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.279418 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:14.279982 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.280002 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.281997 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.282001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.284195 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.284216 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.286317 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.286325 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.286555 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.286655 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.286790 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.287000 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":52,"thread_start_us":891,"threads_started":1}
I20260811 01:35:14.288371 10102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.276843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:37875 (local address 127.0.0.1:45364)
0811 01:35:14.279021 (+ 2178us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.279041 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.279157 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.280080 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.280087 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.280118 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:14.280472 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.280484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.282447 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.282452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.284649 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.284668 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.286588 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.286593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.287766 (+ 1173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.287802 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.287908 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.288053 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2055,"mutex_wait_us":32,"thread_start_us":1900,"threads_started":1}
I20260811 01:35:14.289074 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.276851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.23.39.194:37875)
0811 01:35:14.277567 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.277576 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.279303 (+ 1727us) server_negotiation.cc:407] Connection header received
0811 01:35:14.279405 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.279412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.279625 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.279822 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:14.280652 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.282249 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.284847 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.286341 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.286500 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.286718 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.288633 (+ 1915us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.288834 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":455,"threads_started":1}
I20260811 01:35:14.290897 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.279123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:33869 (local address 127.0.0.1:33470)
0811 01:35:14.279863 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.279881 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.280012 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.281262 (+ 1250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.281269 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.281296 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:14.281607 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.281617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.283946 (+ 2329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.283953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.286360 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.286371 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.290169 (+ 3798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.290178 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.290362 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.290400 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.290469 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.290616 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":3,"thread_start_us":722,"threads_started":1}
I20260811 01:35:14.291787 10104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.279687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33470 (local address 127.23.39.195:33869)
0811 01:35:14.280671 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.280688 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.280719 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:35:14.280816 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.280822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.281036 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.281241 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:14.281907 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.283805 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.286578 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.288446 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.291165 (+ 2719us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.291382 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.291438 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.291559 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":646,"threads_started":1}
I20260811 01:35:14.291678 9720 tablet_service.cc:1467] Processing CreateTablet for tablet 9736a008d93b41feac98b3882af3ca0d (DEFAULT_TABLE table=test-table [id=ee5e4d7a39344f19ac650dd3874fe925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:14.292456 9867 tablet_service.cc:1467] Processing CreateTablet for tablet 9736a008d93b41feac98b3882af3ca0d (DEFAULT_TABLE table=test-table [id=ee5e4d7a39344f19ac650dd3874fe925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:14.293318 9720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9736a008d93b41feac98b3882af3ca0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:14.293776 9867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9736a008d93b41feac98b3882af3ca0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:14.294890 10010 tablet_service.cc:1467] Processing CreateTablet for tablet 9736a008d93b41feac98b3882af3ca0d (DEFAULT_TABLE table=test-table [id=ee5e4d7a39344f19ac650dd3874fe925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:14.296214 10010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9736a008d93b41feac98b3882af3ca0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:14.310983 10108 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Bootstrap starting.
I20260811 01:35:14.314621 10106 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Bootstrap starting.
I20260811 01:35:14.315063 10107 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Bootstrap starting.
I20260811 01:35:14.317556 10108 tablet_bootstrap.cc:654] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:14.318636 10107 tablet_bootstrap.cc:654] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:14.319046 10108 log.cc:824] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:14.319224 10106 tablet_bootstrap.cc:654] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:14.319957 10107 log.cc:824] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:14.320497 10106 log.cc:824] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:14.322932 10108 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: No bootstrap required, opened a new log
I20260811 01:35:14.323282 10108 ts_tablet_manager.cc:1397] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260811 01:35:14.323783 10107 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: No bootstrap required, opened a new log
I20260811 01:35:14.324064 10107 ts_tablet_manager.cc:1397] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:35:14.324268 10106 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: No bootstrap required, opened a new log
I20260811 01:35:14.324533 10106 ts_tablet_manager.cc:1397] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260811 01:35:14.333133 10107 raft_consensus.cc:348] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.333626 10107 raft_consensus.cc:374] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:14.333736 10107 raft_consensus.cc:729] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711d0d51514470ab76feb1c015926cf, State: Initialized, Role: FOLLOWER
I20260811 01:35:14.334447 10107 consensus_queue.cc:260] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.334448 10108 raft_consensus.cc:348] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.334910 10108 raft_consensus.cc:374] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:14.335019 10108 raft_consensus.cc:729] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 798c6549c8f1444ab7ea6f204a968fa0, State: Initialized, Role: FOLLOWER
I20260811 01:35:14.335593 10106 raft_consensus.cc:348] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.336073 10106 raft_consensus.cc:374] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:14.336177 10106 raft_consensus.cc:729] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c44a1cefa8b48eebe63a8c32fc1b77e, State: Initialized, Role: FOLLOWER
I20260811 01:35:14.336558 10107 ts_tablet_manager.cc:1428] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260811 01:35:14.336807 10106 consensus_queue.cc:260] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.336951 10108 consensus_queue.cc:260] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.338629 10086 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:35:14.341419 9939 heartbeater.cc:503] Master 127.23.39.254:39889 was elected leader, sending a full tablet report...
I20260811 01:35:14.342504 10108 ts_tablet_manager.cc:1428] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Time spent starting tablet: real 0.019s user 0.014s sys 0.005s
I20260811 01:35:14.342820 10106 ts_tablet_manager.cc:1428] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
I20260811 01:35:14.368005 10114 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:14.368394 10114 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.370223 10114 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
I20260811 01:35:14.380270 10104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.370817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:50469 (local address 127.23.39.195:33869)
0811 01:35:14.371010 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.371017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.371946 (+ 929us) server_negotiation.cc:407] Connection header received
0811 01:35:14.372254 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.372259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.372336 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.372450 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:14.373487 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.374704 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.378089 (+ 3385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.379213 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.379418 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.379500 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.379842 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.379983 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:35:14.380455 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.370647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:33869 (local address 127.23.39.194:50469)
0811 01:35:14.371815 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.371831 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.372005 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.372516 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.372521 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.372565 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:14.373296 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.373304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.374879 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.374885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.377822 (+ 2937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.377842 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.379467 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.379474 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.379645 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.379675 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.379800 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.380001 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1045,"mutex_wait_us":295,"spinlock_wait_cycles":38656,"thread_start_us":642,"threads_started":1}
I20260811 01:35:14.380697 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.370771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:52897 (local address 127.23.39.193:40927)
0811 01:35:14.371010 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.371017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.371946 (+ 929us) server_negotiation.cc:407] Connection header received
0811 01:35:14.372246 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.372252 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.372337 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.372450 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:14.373486 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.374693 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.378065 (+ 3372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.379222 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.379411 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.379496 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.380077 (+ 581us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.380212 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:35:14.380964 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.370583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.23.39.194:52897)
0811 01:35:14.371776 (+ 1193us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.371805 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:14.372005 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:14.372516 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:14.372521 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:14.372563 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:14.373248 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.373270 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.374878 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.374885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.377830 (+ 2945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:14.377842 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.379673 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.379681 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:14.379908 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.379934 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 01:35:14.380050 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 01:35:14.380202 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":338,"spinlock_wait_cycles":37504,"thread_start_us":706,"threads_started":1}
I20260811 01:35:14.381705 10032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9736a008d93b41feac98b3882af3ca0d" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" is_pre_election: true
I20260811 01:35:14.381910 9742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9736a008d93b41feac98b3882af3ca0d" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711d0d51514470ab76feb1c015926cf" is_pre_election: true
I20260811 01:35:14.382400 10032 raft_consensus.cc:2454] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 0.
I20260811 01:35:14.382586 9742 raft_consensus.cc:2454] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 0.
I20260811 01:35:14.383358 9818 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0, c711d0d51514470ab76feb1c015926cf; no voters:
I20260811 01:35:14.383846 10114 raft_consensus.cc:2781] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:35:14.383996 10114 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:35:14.384105 10114 raft_consensus.cc:3037] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:14.386518 10114 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.387243 10114 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 election: Requested vote from peers c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
I20260811 01:35:14.387801 9742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9736a008d93b41feac98b3882af3ca0d" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c711d0d51514470ab76feb1c015926cf"
I20260811 01:35:14.387846 10032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9736a008d93b41feac98b3882af3ca0d" candidate_uuid: "798c6549c8f1444ab7ea6f204a968fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
I20260811 01:35:14.388015 9742 raft_consensus.cc:3037] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:14.388145 10032 raft_consensus.cc:3037] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:14.390622 9742 raft_consensus.cc:2454] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 1.
I20260811 01:35:14.390722 10032 raft_consensus.cc:2454] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 798c6549c8f1444ab7ea6f204a968fa0 in term 1.
I20260811 01:35:14.391178 9818 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 798c6549c8f1444ab7ea6f204a968fa0, c711d0d51514470ab76feb1c015926cf; no voters:
I20260811 01:35:14.391544 10114 raft_consensus.cc:2781] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:35:14.392067 10114 raft_consensus.cc:686] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 798c6549c8f1444ab7ea6f204a968fa0, State: Running, Role: LEADER
I20260811 01:35:14.392633 10114 consensus_queue.cc:237] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:14.397300 9589 catalog_manager.cc:5495] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "798c6549c8f1444ab7ea6f204a968fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } health_report { overall_health: UNKNOWN } } }
I20260811 01:35:14.416311 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.410122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45366 (local address 127.23.39.194:37875)
0811 01:35:14.410364 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.410369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.410387 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:35:14.410574 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.410578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.410657 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.410798 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:35:14.411265 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.412002 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.413582 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.414014 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.414255 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.414866 (+ 611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:35:14.415475 (+ 609us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:35:14.415605 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.415816 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.415905 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 01:35:14.426445 10032 raft_consensus.cc:1261] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Refusing update from remote peer 798c6549c8f1444ab7ea6f204a968fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:35:14.426450 9742 raft_consensus.cc:1261] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Refusing update from remote peer 798c6549c8f1444ab7ea6f204a968fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:35:14.427537 10118 consensus_queue.cc:1035] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:35:14.427960 10114 consensus_queue.cc:1035] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 01:35:14.431855 9940 tablet.cc:2369] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:35:14.447713 10087 tablet.cc:2369] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:35:14.458262 9589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:35:14.458596 9589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:35:14.462586 9589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Sending DeleteTablet for 3 replicas of tablet 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:14.463922 9867 tablet_service.cc:1514] Processing DeleteTablet for tablet 9736a008d93b41feac98b3882af3ca0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:14 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:45364
I20260811 01:35:14.464049 9720 tablet_service.cc:1514] Processing DeleteTablet for tablet 9736a008d93b41feac98b3882af3ca0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:14 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:39420
I20260811 01:35:14.464509 10010 tablet_service.cc:1514] Processing DeleteTablet for tablet 9736a008d93b41feac98b3882af3ca0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:14 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:33470
I20260811 01:35:14.465961 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9631
I20260811 01:35:14.475699 10131 tablet_replica.cc:330] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: stopping tablet replica
I20260811 01:35:14.476574 10131 raft_consensus.cc:2229] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:35:14.477432 10131 raft_consensus.cc:2258] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:35:14.480197 10131 ts_tablet_manager.cc:1905] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:35:14.486575 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.467312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39428 (local address 127.23.39.193:40927)
0811 01:35:14.467538 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.467548 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.467575 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:35:14.467763 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.467772 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.467880 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.468012 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.469875 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.471493 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.473504 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.474450 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.474598 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.478282 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.478303 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.478321 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.478377 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.482471 (+ 4094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.483515 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.483526 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.483532 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.483703 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.484161 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.484169 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.484174 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.484681 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.484969 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.485774 (+ 805us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.486019 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:35:14.487568 10130 tablet_replica.cc:330] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: stopping tablet replica
I20260811 01:35:14.487632 9788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:14.489746 10131 ts_tablet_manager.cc:1918] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:35:14.489790 10129 tablet_replica.cc:330] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: stopping tablet replica
I20260811 01:35:14.489943 10131 log.cc:1196] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:14.490402 10129 raft_consensus.cc:2229] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:35:14.490645 10131 ts_tablet_manager.cc:1939] T 9736a008d93b41feac98b3882af3ca0d P 5c44a1cefa8b48eebe63a8c32fc1b77e: Deleting consensus metadata
I20260811 01:35:14.491111 10129 raft_consensus.cc:2258] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:35:14.493139 9567 catalog_manager.cc:4841] TS 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): tablet 9736a008d93b41feac98b3882af3ca0d (table test-table [id=ee5e4d7a39344f19ac650dd3874fe925]) successfully deleted
I20260811 01:35:14.493419 10129 ts_tablet_manager.cc:1905] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:35:14.501951 10129 ts_tablet_manager.cc:1918] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:35:14.502190 10129 log.cc:1196] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:14.502810 10129 ts_tablet_manager.cc:1939] T 9736a008d93b41feac98b3882af3ca0d P 798c6549c8f1444ab7ea6f204a968fa0: Deleting consensus metadata
I20260811 01:35:14.504845 9567 catalog_manager.cc:4841] TS 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): tablet 9736a008d93b41feac98b3882af3ca0d (table test-table [id=ee5e4d7a39344f19ac650dd3874fe925]) successfully deleted
I20260811 01:35:14.488238 10130 raft_consensus.cc:2229] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:35:14.587598 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9631
I20260811 01:35:14.587548 10130 raft_consensus.cc:2258] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 01:35:14.609555 9568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:40927 (error 108)
I20260811 01:35:14.609848 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9797
I20260811 01:35:14.612138 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.611721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39442)
0811 01:35:14.611896 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.611996 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:35:14.612458 9568 catalog_manager.cc:4584] TS c711d0d51514470ab76feb1c015926cf (127.23.39.193:40927): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9736a008d93b41feac98b3882af3ca0d: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
I20260811 01:35:14.633096 10100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.610812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.23.39.194:37875)
0811 01:35:14.611011 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.611019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.611046 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:35:14.611190 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.611197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.611306 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.611411 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.613346 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.614379 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.616382 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.616803 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.616905 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.625920 (+ 9015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.625938 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.625955 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.626005 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.629710 (+ 3705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.630835 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.630842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.630845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.631017 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.631469 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.631473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.631475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.631873 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.632179 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.632538 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.632783 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 01:35:14.633927 9933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:14.666563 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.665712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39452)
0811 01:35:14.666210 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.666348 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281}
I20260811 01:35:14.668161 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.667739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39464)
0811 01:35:14.667907 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.668017 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:35:14.729130 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.728540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39480)
0811 01:35:14.728813 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.728933 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 01:35:14.730353 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.729945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39494)
0811 01:35:14.730099 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.730211 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 01:35:14.760002 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9797
I20260811 01:35:14.784854 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9942
I20260811 01:35:14.799680 10104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.785664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33472 (local address 127.23.39.195:33869)
0811 01:35:14.785852 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:14.785857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:14.785878 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:35:14.786125 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:14.786196 (+ 71us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:14.786302 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:14.786407 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:14.787794 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.788739 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.790308 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:14.790732 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:14.790854 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:14.793707 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:14.793723 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:14.793739 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:14.793803 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:14.796775 (+ 2972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.797484 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.797492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.797494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.797638 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:14.798018 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:14.798021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:14.798023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:14.798535 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:14.798771 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:14.799209 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 01:35:14.799410 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:35:14.800490 10081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:14.811213 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.810549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39496)
0811 01:35:14.810834 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.810976 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 01:35:14.812667 10103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:14.812097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:40927 (local address 127.0.0.1:39504)
0811 01:35:14.812363 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:14.812483 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:40927: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260811 01:35:14.895037 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9942
I20260811 01:35:14.916891 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 9548
I20260811 01:35:14.918295 9623 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:15.039106 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 9548
I20260811 01:35:35.063665 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--webserver_interface=127.23.39.254
--webserver_port=36783
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:35.435133 10139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:35.435451 10139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:35.435616 10139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:35.443369 10139 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 01:35:35.443491 10139 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 01:35:35.443560 10139 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 01:35:35.443637 10139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:35:35.443742 10139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:35.443837 10139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:35.443929 10139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:35:35.444023 10139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:35:35.454912 10139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=36783
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:35.456341 10139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:35.457762 10139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:35.470696 10150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:35.470678 10148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:35.471253 10147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:35.471971 10139 server_base.cc:1034] running on GCE node
I20260811 01:35:35.472892 10139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:35.474587 10139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:35.475835 10139 hybrid_clock.cc:648] HybridClock initialized: now 1786412135475750 us; error 62 us; skew 500 ppm
I20260811 01:35:35.476227 10139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:35 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412135, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:35.479779 10139 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:35:35.481455 10139 webserver.cc:460] Webserver started at http://127.23.39.254:36783/ using document root <none> and password file <none>
I20260811 01:35:35.482303 10139 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:35.482414 10139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:35.488622 10139 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:35:35.492048 10159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:35.493707 10139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:35:35.493966 10139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "249079e9faad4d6990286334f85d591b"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "27d72cf4512d36a86f5822229054532e"
server_key_iv: "661af7bc8c504eddf53044d43585d964"
server_key_version: "encryptionkey@0"
I20260811 01:35:35.495178 10139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:35.547320 10139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:35.552546 10139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:35.552866 10139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:35.574252 10139 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39889
I20260811 01:35:35.574353 10213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39889 every 8 connection(s)
I20260811 01:35:35.575901 10139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:35:35.579357 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10139
I20260811 01:35:35.580256 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:40927
--local_ip_for_outbound_sockets=127.23.39.193
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=34687
--webserver_interface=127.23.39.193
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:35:35.583448 10214 sys_catalog.cc:263] Verifying existing consensus state
I20260811 01:35:35.587033 10214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap starting.
I20260811 01:35:35.608976 10214 log.cc:824] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:35.627167 10214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:35:35.627825 10214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Bootstrap complete.
I20260811 01:35:35.637951 10214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:35.639109 10214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249079e9faad4d6990286334f85d591b, State: Initialized, Role: FOLLOWER
I20260811 01:35:35.639875 10214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:35.640179 10214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:35:35.640331 10214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:35:35.640542 10214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 2 FOLLOWER]: Advancing to term 3
I20260811 01:35:35.645192 10214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:35.645924 10214 leader_election.cc:302] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 249079e9faad4d6990286334f85d591b; no voters:
I20260811 01:35:35.646814 10214 leader_election.cc:288] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 01:35:35.646965 10219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 01:35:35.648368 10219 raft_consensus.cc:686] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [term 3 LEADER]: Becoming Leader. State: Replica: 249079e9faad4d6990286334f85d591b, State: Running, Role: LEADER
I20260811 01:35:35.649091 10219 consensus_queue.cc:237] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } }
I20260811 01:35:35.649762 10214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:35:35.651999 10221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 249079e9faad4d6990286334f85d591b. Latest consensus state: current_term: 3 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:35:35.652722 10221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:35.652077 10220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "249079e9faad4d6990286334f85d591b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249079e9faad4d6990286334f85d591b" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39889 } } }
I20260811 01:35:35.653220 10220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:35.658478 10225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:35:35.667701 10225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:35:35.669824 10225 catalog_manager.cc:1259] Loaded cluster ID: 275da7d01d4a4c63868fecc685a0eece
I20260811 01:35:35.670023 10225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:35:35.674559 10237 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:35:35.676699 10225 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:35:35.678290 10225 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Loaded TSK: 0
I20260811 01:35:35.678467 10225 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 249079e9faad4d6990286334f85d591b: Loaded TSK: 1
F20260811 01:35:35.679337 10225 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8e73c819ad google::LogMessage::Fail() at ??:0
@ 0x7f8e73c8488a google::LogMessage::SendToLog() at ??:0
@ 0x7f8e73c814de google::LogMessage::Flush() at ??:0
@ 0x7f8e73c82a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8e779e57d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8e779d473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8e896b01c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8e896af783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8e8973b2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f8e8973b0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f8e897855e9 std::function<>::operator()() at ??:0
@ 0x7f8e896b3cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8e896b1c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8e89739610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8e89739439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8e768cd345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8e768d091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8e768d0799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8e768abeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8e79b856db start_thread at ??:0
@ 0x7f8e72b1b61f clone at ??:0
W20260811 01:35:36.010237 10216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:36.010627 10216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:36.010813 10216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:36.018695 10216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:36.018895 10216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:36.019088 10216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:35:36.030215 10216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:40927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=34687
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:36.031699 10216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:36.033193 10216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:36.048355 10269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:36.048379 10273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:36.048405 10270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:36.049152 10216 server_base.cc:1034] running on GCE node
I20260811 01:35:36.050012 10216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:36.051316 10216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:36.052623 10216 hybrid_clock.cc:648] HybridClock initialized: now 1786412136052537 us; error 77 us; skew 500 ppm
I20260811 01:35:36.053048 10216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:36 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412136, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:36.062486 10216 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:35:36.064327 10216 webserver.cc:460] Webserver started at http://127.23.39.193:34687/ using document root <none> and password file <none>
I20260811 01:35:36.065161 10216 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:36.065371 10216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:36.071957 10216 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 01:35:36.075441 10280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:36.077435 10216 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:35:36.077730 10216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "c711d0d51514470ab76feb1c015926cf"
format_stamp: "Formatted at 2026-08-11 01:34:49 on dist-test-slave-9jjr"
server_key: "af80da351e40471601d5c60668bfddbd"
server_key_iv: "a192a33a4e761fb3204716946dea6a74"
server_key_version: "encryptionkey@0"
I20260811 01:35:36.079119 10216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:36.106889 10216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:36.112068 10216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:36.112440 10216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:36.113643 10216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:36.115934 10289 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260811 01:35:36.122285 10216 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 01:35:36.122444 10216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260811 01:35:36.122610 10216 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 01:35:36.126266 10216 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 01:35:36.126368 10216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.003s
I20260811 01:35:36.126946 10289 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Bootstrap starting.
I20260811 01:35:36.158809 10289 log.cc:824] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:36.169884 10405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:40927 every 8 connection(s)
I20260811 01:35:36.169884 10216 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:40927
I20260811 01:35:36.171444 10216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:35:36.174167 10289 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 01:35:36.174898 10289 tablet_bootstrap.cc:492] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Bootstrap complete.
I20260811 01:35:36.176743 10289 ts_tablet_manager.cc:1397] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Time spent bootstrapping tablet: real 0.050s user 0.030s sys 0.016s
I20260811 01:35:36.177174 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.174797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:55509)
0811 01:35:36.175729 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.176020 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":411,"threads_started":1}
I20260811 01:35:36.177488 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10216
I20260811 01:35:36.178272 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:37875
--local_ip_for_outbound_sockets=127.23.39.194
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=35949
--webserver_interface=127.23.39.194
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:36.178341 10406 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:39889 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:39889: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
I20260811 01:35:36.179539 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.178971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:43983)
0811 01:35:36.179209 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.179334 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 01:35:36.180855 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.180300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:59509)
0811 01:35:36.180508 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.180638 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 01:35:36.181109 10406 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:35:36.185189 10289 raft_consensus.cc:348] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:36.186236 10289 raft_consensus.cc:729] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c711d0d51514470ab76feb1c015926cf, State: Initialized, Role: FOLLOWER
I20260811 01:35:36.186985 10289 consensus_queue.cc:260] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:36.188889 10289 ts_tablet_manager.cc:1428] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260811 01:35:36.189098 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.188563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:39967)
0811 01:35:36.188775 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.188908 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:35:36.190716 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.189729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:44267)
0811 01:35:36.190393 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.190491 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":312,"threads_started":1}
W20260811 01:35:36.545938 10411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:36.546357 10411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:36.546469 10411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:36.553942 10411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:36.554070 10411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:36.554266 10411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:35:36.564576 10411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:37875
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=35949
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:36.565936 10411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:36.567310 10411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:36.581506 10418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:36.581662 10421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:36.581687 10417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:36.582871 10411 server_base.cc:1034] running on GCE node
I20260811 01:35:36.583616 10411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:36.584775 10411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:36.586051 10411 hybrid_clock.cc:648] HybridClock initialized: now 1786412136585978 us; error 63 us; skew 500 ppm
I20260811 01:35:36.586484 10411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:36 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412136, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:36.589861 10411 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:35:36.591650 10411 webserver.cc:460] Webserver started at http://127.23.39.194:35949/ using document root <none> and password file <none>
I20260811 01:35:36.592471 10411 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:36.592640 10411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:36.598376 10411 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 01:35:36.601202 10429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:36.602834 10411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:35:36.603034 10411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "798c6549c8f1444ab7ea6f204a968fa0"
format_stamp: "Formatted at 2026-08-11 01:34:50 on dist-test-slave-9jjr"
server_key: "8f52b5349d4f38fb098d0e62d8b31a5d"
server_key_iv: "de24d2699e115ba94417fd56f1657ccc"
server_key_version: "encryptionkey@0"
I20260811 01:35:36.604151 10411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:36.641399 10411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:36.646207 10411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:36.646528 10411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:36.647687 10411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:36.649406 10411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:36.649566 10411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:36.649725 10411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:36.649821 10411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:36.690449 10411 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:37875
I20260811 01:35:36.690588 10552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:37875 every 8 connection(s)
I20260811 01:35:36.692077 10411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:35:36.694834 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10411
I20260811 01:35:36.695516 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:33869
--local_ip_for_outbound_sockets=127.23.39.195
--tserver_master_addrs=127.23.39.254:39889
--webserver_port=35709
--webserver_interface=127.23.39.195
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:35:36.698037 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.695346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:39519)
0811 01:35:36.696420 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.696764 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":477,"threads_started":1}
W20260811 01:35:36.698819 10554 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:39889 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:39889: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
I20260811 01:35:36.699906 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.699508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:51341)
0811 01:35:36.699706 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.699784 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 01:35:36.700904 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:36.700559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:38665)
0811 01:35:36.700717 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:36.700794 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:35:36.701234 10554 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 01:35:37.063292 10557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:37.063598 10557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:37.063778 10557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:37.072011 10557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:37.072149 10557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:37.072356 10557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:35:37.082964 10557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:33869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=35709
--tserver_master_addrs=127.23.39.254:39889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:37.084537 10557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:37.085973 10557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:37.100896 10563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:37.100945 10566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:37.100890 10562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:37.102430 10557 server_base.cc:1034] running on GCE node
I20260811 01:35:37.103241 10557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:37.104435 10557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:37.105734 10557 hybrid_clock.cc:648] HybridClock initialized: now 1786412137105659 us; error 72 us; skew 500 ppm
I20260811 01:35:37.106194 10557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:37 dist-test-slave-9jjr krb5kdc[8916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412137, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:37.109959 10557 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:35:37.111737 10557 webserver.cc:460] Webserver started at http://127.23.39.195:35709/ using document root <none> and password file <none>
I20260811 01:35:37.112509 10557 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:37.112689 10557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:37.119397 10557 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 01:35:37.122875 10573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:37.124753 10557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260811 01:35:37.125005 10557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e"
format_stamp: "Formatted at 2026-08-11 01:34:51 on dist-test-slave-9jjr"
server_key: "f5b7d9884f3a76db2a1ded1ed754cc5f"
server_key_iv: "6296d0b877b9f82389fd8e4c2aba089f"
server_key_version: "encryptionkey@0"
I20260811 01:35:37.126267 10557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:37.149312 10557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:37.155006 10557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:37.155388 10557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:37.156770 10557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:37.158507 10557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:37.158669 10557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:37.158833 10557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:37.158938 10557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:37.193269 10687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.191816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:57721)
0811 01:35:37.192752 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.192926 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":617,"threads_started":1}
I20260811 01:35:37.197490 10557 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:33869
I20260811 01:35:37.197602 10702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:33869 every 8 connection(s)
I20260811 01:35:37.199157 10557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:35:37.202696 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10557
I20260811 01:35:37.205371 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.202545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:45577)
0811 01:35:37.203669 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.203948 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":808,"thread_start_us":528,"threads_started":1}
W20260811 01:35:37.206269 10703 heartbeater.cc:644] Failed to heartbeat to 127.23.39.254:39889 (0 consecutive failures): Network error: Failed to ping master at 127.23.39.254:39889: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
I20260811 01:35:37.207264 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.206850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:34127)
0811 01:35:37.207046 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.207139 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:35:37.208321 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.207918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:45907)
0811 01:35:37.208103 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.208194 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 01:35:37.208603 10703 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 01:35:37.702983 10707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.701897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:49519)
0811 01:35:37.702552 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.702687 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":367,"threads_started":1}
I20260811 01:35:37.969111 10708 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:37.969466 10708 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:37.971128 10708 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
Aug 11 01:35:37 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412136, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
Aug 11 01:35:37 dist-test-slave-9jjr krb5kdc[8916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412136, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:35:37.995599 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.973579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:40477 (local address 127.23.39.195:33869)
0811 01:35:37.974285 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:37.974299 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:37.974335 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:35:37.976451 (+ 2116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:37.976465 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:37.976982 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:37.977338 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:37.979574 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.980729 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.982643 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.983383 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.983596 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:37.988546 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:37.988554 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:37.988568 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:37.988614 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:37.991740 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:37.992563 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:37.992570 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:37.992575 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:37.992746 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:37.993174 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:37.993178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:37.993180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:37.993711 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:37.993926 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:37.994795 (+ 869us) server_negotiation.cc:299] Negotiation successful
0811 01:35:37.995195 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":348,"threads_started":1}
I20260811 01:35:37.995615 10712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.971940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:39023 (local address 127.23.39.194:37875)
0811 01:35:37.972767 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:37.972786 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:37.973252 (+ 466us) server_negotiation.cc:407] Connection header received
0811 01:35:37.976464 (+ 3212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:37.976473 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:37.976982 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:37.977338 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:37.979561 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.980760 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.982651 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.983404 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.983619 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:37.988326 (+ 4707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:37.988335 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:37.988351 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:37.988401 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:37.991546 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:37.992443 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:37.992450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:37.992456 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:37.992613 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:37.993101 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:37.993112 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:37.993114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:37.993726 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:37.993944 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:37.994823 (+ 879us) server_negotiation.cc:299] Negotiation successful
0811 01:35:37.995215 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":413,"threads_started":1}
I20260811 01:35:37.995612 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.971537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:37875 (local address 127.23.39.193:39023)
0811 01:35:37.973058 (+ 1521us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.973105 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:37.973772 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:37.977983 (+ 4211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:37.977986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:37.978609 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:37.979331 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:37.979353 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.980954 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.980958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:37.982487 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:37.982500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.983632 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.983639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:37.983953 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:37.985006 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:37.985046 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:37.987955 (+ 2909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:37.991740 (+ 3785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:37.991749 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:37.991766 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:37.992272 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:37.992739 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:37.992747 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:37.992752 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:37.992968 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:37.993868 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:37.993873 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:37.994277 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 01:35:37.994563 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 01:35:37.995132 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1381,"mutex_wait_us":210,"spinlock_wait_cycles":26752,"thread_start_us":1216,"threads_started":1}
I20260811 01:35:37.997053 10713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:37.973232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:33869 (local address 127.23.39.193:40477)
0811 01:35:37.973762 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:37.973783 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:37.973922 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:37.977525 (+ 3603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:37.977534 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:37.978540 (+ 1006us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:37.979349 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:37.979362 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.980949 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.980953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:37.982489 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:37.982501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:37.983613 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:37.983620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:37.983935 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:37.985123 (+ 1188us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:37.985149 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:37.988243 (+ 3094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:37.991908 (+ 3665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:37.991914 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:37.991918 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:37.992403 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:37.992873 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:37.992878 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:37.992886 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:37.993036 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:37.993861 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:37.993869 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:37.994279 (+ 410us) client_negotiation.cc:769] Sending connection context
0811 01:35:37.994563 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 01:35:37.996654 (+ 2091us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":1638,"spinlock_wait_cycles":55936,"thread_start_us":238,"threads_started":1}
W20260811 01:35:37.999560 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
W20260811 01:35:37.999981 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:38.000106 10283 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711d0d51514470ab76feb1c015926cf; no voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0
I20260811 01:35:38.000598 10708 raft_consensus.cc:2726] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:35:38.194883 10713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:38.194360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:55183)
0811 01:35:38.194534 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:38.194715 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 01:35:38.209992 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:38.209115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:50947)
0811 01:35:38.209602 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:38.209754 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":220,"threads_started":1}
I20260811 01:35:38.704646 10716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:38.703946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:54617)
0811 01:35:38.704393 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:38.704477 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":237,"threads_started":1}
I20260811 01:35:39.196833 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:39.195954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:55273)
0811 01:35:39.196516 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:39.196618 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":255,"threads_started":1}
I20260811 01:35:39.211953 10718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:39.210996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:54775)
0811 01:35:39.211672 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:39.211781 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":248,"threads_started":1}
I20260811 01:35:39.706763 10719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:39.705821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:37351)
0811 01:35:39.706470 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:39.706577 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":404,"threads_started":1}
I20260811 01:35:40.198693 10720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:40.197897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:57255)
0811 01:35:40.198456 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:40.198535 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":338,"threads_started":1}
I20260811 01:35:40.213936 10721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:40.213022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:60799)
0811 01:35:40.213671 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:40.213764 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":387,"threads_started":1}
I20260811 01:35:40.224006 10722 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:40.224210 10722 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:40.224851 10722 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
W20260811 01:35:40.226118 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
W20260811 01:35:40.226447 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:40.226572 10283 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711d0d51514470ab76feb1c015926cf; no voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0
I20260811 01:35:40.226871 10722 raft_consensus.cc:2726] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:35:40.708874 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:40.707851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:34741)
0811 01:35:40.708464 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:40.708609 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":313,"threads_started":1}
I20260811 01:35:41.200703 10726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:41.199820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:40983)
0811 01:35:41.200352 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:41.200437 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":303,"threads_started":1}
I20260811 01:35:41.215678 10728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:41.214893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:59249)
0811 01:35:41.215404 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:41.215495 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":261,"threads_started":1}
I20260811 01:35:41.710845 10729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:41.710000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:48387)
0811 01:35:41.710574 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:41.710679 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":317,"threads_started":1}
I20260811 01:35:42.202999 10731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:42.202248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:50437)
0811 01:35:42.202734 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:42.202832 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":250,"threads_started":1}
I20260811 01:35:42.217718 10733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:42.216830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:46789)
0811 01:35:42.217411 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:42.217518 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":250,"threads_started":1}
I20260811 01:35:42.712543 10734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:42.711755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:37823)
0811 01:35:42.712251 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:42.712345 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":264,"threads_started":1}
I20260811 01:35:43.204761 10735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:43.204006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:41131)
0811 01:35:43.204473 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:43.204554 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":248,"threads_started":1}
I20260811 01:35:43.219601 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:43.218797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:42867)
0811 01:35:43.219314 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:43.219407 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":273,"threads_started":1}
I20260811 01:35:43.249358 10738 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:43.249621 10738 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:43.250455 10738 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
W20260811 01:35:43.251598 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
W20260811 01:35:43.251798 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:43.251909 10283 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711d0d51514470ab76feb1c015926cf; no voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0
I20260811 01:35:43.252151 10738 raft_consensus.cc:2726] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:35:43.714619 10739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:43.713639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:46723)
0811 01:35:43.714307 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:43.714414 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":270,"threads_started":1}
I20260811 01:35:44.206511 10740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:44.205710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:51175)
0811 01:35:44.206242 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:44.206338 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":240,"threads_started":1}
I20260811 01:35:44.221712 10741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:44.220758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:50313)
0811 01:35:44.221415 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:44.221508 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":342,"threads_started":1}
I20260811 01:35:44.716886 10744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:44.715847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:48895)
0811 01:35:44.716570 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:44.716675 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":473,"threads_started":1}
I20260811 01:35:45.208711 10745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:45.207573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:35185)
0811 01:35:45.208346 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:45.208475 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":459,"threads_started":1}
I20260811 01:35:45.223579 10746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:45.222789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:51419)
0811 01:35:45.223296 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:45.223383 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":274,"threads_started":1}
I20260811 01:35:45.718900 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:45.717939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:46405)
0811 01:35:45.718622 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:45.718732 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":369,"threads_started":1}
I20260811 01:35:46.210781 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:46.209871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:47425)
0811 01:35:46.210493 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:46.210588 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":375,"threads_started":1}
I20260811 01:35:46.225555 10750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:46.224749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:39161)
0811 01:35:46.225293 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:46.225395 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":251,"threads_started":1}
I20260811 01:35:46.720752 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:46.719930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:58493)
0811 01:35:46.720448 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:46.720543 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":268,"threads_started":1}
I20260811 01:35:47.212518 10753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:47.211796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:56895)
0811 01:35:47.212246 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:47.212334 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":237,"threads_started":1}
I20260811 01:35:47.227420 10754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:47.226666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:54351)
0811 01:35:47.227129 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:47.227227 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":237,"threads_started":1}
I20260811 01:35:47.722995 10755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:47.721975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:37993)
0811 01:35:47.722615 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:47.722772 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":336,"threads_started":1}
I20260811 01:35:47.957846 10756 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:47.958091 10756 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:47.958905 10756 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
W20260811 01:35:47.959987 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
W20260811 01:35:47.960307 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:47.960412 10283 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711d0d51514470ab76feb1c015926cf; no voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0
I20260811 01:35:47.960747 10756 raft_consensus.cc:2726] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:35:48.214623 10757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:48.213598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:54385)
0811 01:35:48.214212 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:48.214361 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":257,"threads_started":1}
I20260811 01:35:48.229274 10758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:48.228425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:33845)
0811 01:35:48.228971 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:48.229068 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":279,"threads_started":1}
I20260811 01:35:48.724961 10759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:48.724141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:54003)
0811 01:35:48.724669 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:48.724766 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":262,"threads_started":1}
I20260811 01:35:49.216365 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:49.215583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:50933)
0811 01:35:49.216049 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:49.216134 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":243,"threads_started":1}
I20260811 01:35:49.231318 10761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:49.230520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:52181)
0811 01:35:49.231025 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:49.231113 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":290,"threads_started":1}
I20260811 01:35:49.726960 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:49.726091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:45723)
0811 01:35:49.726670 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:49.726786 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":277,"threads_started":1}
I20260811 01:35:50.218194 10763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:50.217373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:57107)
0811 01:35:50.217858 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:50.217941 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":257,"threads_started":1}
I20260811 01:35:50.232987 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:50.232203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:35495)
0811 01:35:50.232719 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:50.232817 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":251,"threads_started":1}
I20260811 01:35:50.729008 10766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:50.728118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:46627)
0811 01:35:50.728631 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:50.728770 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":289,"threads_started":1}
I20260811 01:35:51.220176 10767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:51.219390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:36643)
0811 01:35:51.219897 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:51.219978 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":254,"threads_started":1}
I20260811 01:35:51.234760 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:51.233951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:56853)
0811 01:35:51.234456 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:51.234544 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":279,"threads_started":1}
I20260811 01:35:51.278020 10770 raft_consensus.cc:482] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:51.278386 10770 raft_consensus.cc:504] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "798c6549c8f1444ab7ea6f204a968fa0" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 37875 } } peers { permanent_uuid: "c711d0d51514470ab76feb1c015926cf" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 40927 } } peers { permanent_uuid: "5c44a1cefa8b48eebe63a8c32fc1b77e" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 33869 } }
I20260811 01:35:51.279094 10770 leader_election.cc:288] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875), 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869)
W20260811 01:35:51.280241 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 798c6549c8f1444ab7ea6f204a968fa0 (127.23.39.194:37875): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
W20260811 01:35:51.280474 10283 leader_election.cc:341] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5c44a1cefa8b48eebe63a8c32fc1b77e (127.23.39.195:33869): Not found: Tablet not found: 9736a008d93b41feac98b3882af3ca0d
I20260811 01:35:51.280601 10283 leader_election.cc:302] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c711d0d51514470ab76feb1c015926cf; no voters: 5c44a1cefa8b48eebe63a8c32fc1b77e, 798c6549c8f1444ab7ea6f204a968fa0
I20260811 01:35:51.280881 10770 raft_consensus.cc:2726] T 9736a008d93b41feac98b3882af3ca0d P c711d0d51514470ab76feb1c015926cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 01:35:51.731297 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:51.730436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.194:51357)
0811 01:35:51.730954 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:51.731069 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":272,"threads_started":1}
I20260811 01:35:52.206871 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 10216
I20260811 01:35:52.222069 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:52.221095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.193:52169)
0811 01:35:52.221679 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:52.221818 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":318,"threads_started":1}
I20260811 01:35:52.224187 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:52.208226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49224 (local address 127.23.39.193:40927)
0811 01:35:52.209414 (+ 1188us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:52.209428 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:52.209465 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:35:52.209551 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:52.209574 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:52.209878 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:52.210067 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:52.211820 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.212926 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.214349 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.214942 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.215106 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:52.217910 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:52.217923 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:52.217939 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:52.217979 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:52.220894 (+ 2915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.221701 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.221717 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.221720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.221892 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.222406 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.222411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.222421 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.222820 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:52.223194 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:52.223525 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 01:35:52.223827 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":971,"thread_start_us":801,"threads_started":1}
I20260811 01:35:52.225525 10401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:52.236835 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:52.235984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39889 (local address 127.23.39.195:53741)
0811 01:35:52.236553 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:52.236672 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.254:39889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":316,"threads_started":1}
I20260811 01:35:52.323002 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 10216
I20260811 01:35:52.347165 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 10411
I20260811 01:35:52.362113 10776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:52.348118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38146 (local address 127.23.39.194:37875)
0811 01:35:52.348659 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:52.348664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:52.348680 (+ 16us) server_negotiation.cc:407] Connection header received
0811 01:35:52.348745 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:52.348748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:52.348811 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:52.348938 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:52.350484 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.351274 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.352626 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.353099 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.353271 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:52.356213 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:52.356219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:52.356222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:52.356262 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:52.359093 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.359889 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.359895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.359899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.360055 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.360469 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.360474 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.360477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.360800 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:52.361111 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:52.361430 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 01:35:52.361680 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":281,"threads_started":1}
I20260811 01:35:52.363092 10548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:52.452068 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 10411
I20260811 01:35:52.475142 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 10557
I20260811 01:35:52.492065 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:52.476204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42508 (local address 127.23.39.195:33869)
0811 01:35:52.476846 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:52.476851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:52.476868 (+ 17us) server_negotiation.cc:407] Connection header received
0811 01:35:52.476937 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:52.476941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:52.477010 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:52.477154 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:52.478827 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.479655 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.481018 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:52.481577 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:52.481736 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:52.485695 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:52.485702 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:52.485705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:52.485757 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:52.489000 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.489861 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.489867 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.489869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.490074 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:52.490578 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:52.490582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:52.490584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:52.490930 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:52.491153 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:52.491426 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 01:35:52.491641 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":314,"threads_started":1}
I20260811 01:35:52.492859 10698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:52.580880 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 10557
2026-08-11T01:35:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65358 ms)
[----------] 30 tests from SecurityITest (315685 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:35:52 dist-test-slave-9jjr krb5kdc[10783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:35:52 dist-test-slave-9jjr krb5kdc[10783](info): set up 2 sockets
Aug 11 01:35:52 dist-test-slave-9jjr krb5kdc[10783](info): commencing operation
krb5kdc: starting...
W20260811 01:35:53.813817 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:35:54 dist-test-slave-9jjr krb5kdc[10783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:35:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:35:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:35:54.163578 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:37173
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:37173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:54.524883 10797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:54.525208 10797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:54.525377 10797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:54.533188 10797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:35:54.533319 10797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:54.533397 10797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:54.533494 10797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:35:54.533563 10797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:35:54.543859 10797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:37173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:54.545305 10797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:54.546725 10797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:54.558893 10802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:54.558974 10805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:54.558941 10803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:54.559551 10797 server_base.cc:1034] running on GCE node
I20260811 01:35:54.560504 10797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:54.561949 10797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:54.563221 10797 hybrid_clock.cc:648] HybridClock initialized: now 1786412154563189 us; error 56 us; skew 500 ppm
I20260811 01:35:54.563593 10797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:54 dist-test-slave-9jjr krb5kdc[10783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:54.566809 10797 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:35:54.568482 10797 webserver.cc:460] Webserver started at http://127.23.39.254:38715/ using document root <none> and password file <none>
I20260811 01:35:54.569201 10797 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:54.569355 10797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:54.569679 10797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:54.572947 10797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "29a0bdec141c4661997a1479c45cad1f"
format_stamp: "Formatted at 2026-08-11 01:35:54 on dist-test-slave-9jjr"
server_key: "b3108bd273780cd991f089ee0ebf6a63"
server_key_iv: "8c3d9def32a8726fe24df8a4f9e1652f"
server_key_version: "encryptionkey@0"
I20260811 01:35:54.573755 10797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "29a0bdec141c4661997a1479c45cad1f"
format_stamp: "Formatted at 2026-08-11 01:35:54 on dist-test-slave-9jjr"
server_key: "b3108bd273780cd991f089ee0ebf6a63"
server_key_iv: "8c3d9def32a8726fe24df8a4f9e1652f"
server_key_version: "encryptionkey@0"
I20260811 01:35:54.579295 10797 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:35:54.583119 10812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:54.584626 10797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:35:54.584858 10797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "29a0bdec141c4661997a1479c45cad1f"
format_stamp: "Formatted at 2026-08-11 01:35:54 on dist-test-slave-9jjr"
server_key: "b3108bd273780cd991f089ee0ebf6a63"
server_key_iv: "8c3d9def32a8726fe24df8a4f9e1652f"
server_key_version: "encryptionkey@0"
I20260811 01:35:54.585095 10797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:54.604612 10797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:54.609333 10797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:54.609650 10797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:54.630291 10797 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:37173
I20260811 01:35:54.630389 10871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:37173 every 8 connection(s)
I20260811 01:35:54.631819 10797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:35:54.636250 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:54.638760 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10797
I20260811 01:35:54.638983 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:35:54.639712 23711 external_mini_cluster.cc:1428] Setting key 993aa1f8595226f3bbdaa3c424954049
I20260811 01:35:54.650689 10872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: Bootstrap starting.
I20260811 01:35:54.654824 10872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:54.655972 10872 log.cc:824] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:35:54 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:54.660326 10872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: No bootstrap required, opened a new log
I20260811 01:35:54.669533 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:54.642028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36948 (local address 127.23.39.254:37173)
0811 01:35:54.642988 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:54.643005 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:54.643072 (+ 67us) server_negotiation.cc:407] Connection header received
0811 01:35:54.645572 (+ 2500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:54.645608 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:54.646236 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:54.646765 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:54.648312 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:54.650380 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:54.652026 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:54.653230 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:54.653459 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:54.659011 (+ 5552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:54.659027 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:54.659053 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:54.659113 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:54.664214 (+ 5101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:54.665349 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:54.665358 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:54.665369 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:54.665640 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:54.666197 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:54.666202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:54.666206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:54.667004 (+ 798us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:54.667364 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:54.667877 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 01:35:54.668407 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":348,"threads_started":1}
I20260811 01:35:54.670610 10872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } }
I20260811 01:35:54.671039 10872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:54.671185 10872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a0bdec141c4661997a1479c45cad1f, State: Initialized, Role: FOLLOWER
I20260811 01:35:54.671829 10872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } }
I20260811 01:35:54.672107 10872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:35:54.672267 10872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:35:54.672473 10872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:54.675168 10872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } }
I20260811 01:35:54.675683 10872 leader_election.cc:302] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29a0bdec141c4661997a1479c45cad1f; no voters:
I20260811 01:35:54.676286 10872 leader_election.cc:288] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:35:54.676441 10878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:35:54.677215 10878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [term 1 LEADER]: Becoming Leader. State: Replica: 29a0bdec141c4661997a1479c45cad1f, State: Running, Role: LEADER
I20260811 01:35:54.677814 10878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } }
I20260811 01:35:54.678495 10872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:35:54.680799 10879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29a0bdec141c4661997a1479c45cad1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } } }
I20260811 01:35:54.681260 10879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:54.687314 10880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a0bdec141c4661997a1479c45cad1f. Latest consensus state: current_term: 1 leader_uuid: "29a0bdec141c4661997a1479c45cad1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a0bdec141c4661997a1479c45cad1f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 37173 } } }
I20260811 01:35:54.687799 10880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:54.687983 10889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:35:54.694271 10889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:35:54.704005 10889 catalog_manager.cc:1347] Generated new cluster ID: 9cd45d8ee38f4e168de8eebeeae6fefb
I20260811 01:35:54.704144 10889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:35:54.728688 10889 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:35:54.730113 10889 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:35:54.743299 10889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: Generated new TSK 0
I20260811 01:35:54.744242 10889 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:35:54.838502 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:55.198522 10902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:55.198829 10902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:55.199023 10902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:55.206868 10902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:55.207015 10902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:55.207211 10902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:35:55.217461 10902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:55.218925 10902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:55.220327 10902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:55.234202 10907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:55.234297 10911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:55.234238 10909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:55.235140 10902 server_base.cc:1034] running on GCE node
I20260811 01:35:55.235875 10902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:55.236908 10902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:55.238189 10902 hybrid_clock.cc:648] HybridClock initialized: now 1786412155238090 us; error 43 us; skew 500 ppm
I20260811 01:35:55.238565 10902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:55 dist-test-slave-9jjr krb5kdc[10783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412155, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:55.241856 10902 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:35:55.243736 10902 webserver.cc:460] Webserver started at http://127.23.39.193:46593/ using document root <none> and password file <none>
I20260811 01:35:55.244446 10902 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:55.244585 10902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:55.244920 10902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:55.248049 10902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "16a390829b504d2594b23fc34df4b185"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "a99891c1b4d391c88aede01c28004495"
server_key_iv: "c83258c2c60276be30499b6ef2cd2875"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.248862 10902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "16a390829b504d2594b23fc34df4b185"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "a99891c1b4d391c88aede01c28004495"
server_key_iv: "c83258c2c60276be30499b6ef2cd2875"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.254393 10902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260811 01:35:55.260389 10918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.262223 10902 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:35:55.262724 10902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "16a390829b504d2594b23fc34df4b185"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "a99891c1b4d391c88aede01c28004495"
server_key_iv: "c83258c2c60276be30499b6ef2cd2875"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.262956 10902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:55.280561 10902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:55.285346 10902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:55.285702 10902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:55.286861 10902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:55.288381 10902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:55.288503 10902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.288672 10902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:55.288748 10902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.325599 10902 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:42029
I20260811 01:35:55.325613 11037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:42029 every 8 connection(s)
I20260811 01:35:55.327363 10902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:35:55.334861 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 10902
I20260811 01:35:55.335129 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:35:55.335778 23711 external_mini_cluster.cc:1428] Setting key 83b2bbeb9ef9bbe2a0c7ca36022a6ebf
Aug 11 01:35:55 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412155, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:55.351401 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:55.330477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:50739 (local address 127.23.39.254:37173)
0811 01:35:55.330963 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:55.330968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:55.331995 (+ 1027us) server_negotiation.cc:407] Connection header received
0811 01:35:55.333914 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:55.333919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:55.334005 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:55.334220 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:55.336026 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.336938 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.338860 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.339293 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.339453 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:55.343225 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:55.343235 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:55.343243 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:55.343299 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:55.347516 (+ 4217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:55.348425 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:55.348434 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:55.348441 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:55.348617 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:55.349062 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:55.349070 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:55.349076 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:55.349516 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:55.349690 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:55.350549 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 01:35:55.350866 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":240,"threads_started":1}
I20260811 01:35:55.351989 11042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:55.331057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:37173 (local address 127.23.39.193:50739)
0811 01:35:55.331815 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:55.331854 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:55.333611 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:55.334430 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:55.334438 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:55.335079 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:55.335757 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:55.335776 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.337172 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.337177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:55.338696 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:55.338711 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.339557 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.339566 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:55.339831 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:55.340558 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:55.340582 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:55.342934 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:55.347740 (+ 4806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:55.347749 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:55.347764 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:55.348260 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:55.348738 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:55.348741 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:55.348743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:55.348935 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:55.349668 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:55.349675 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:55.350035 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 01:35:55.350354 (+ 319us) client_negotiation.cc:240] Negotiation successful
0811 01:35:55.350792 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":290,"threads_started":1}
I20260811 01:35:55.353905 11038 heartbeater.cc:347] Connected to a master server at 127.23.39.254:37173
I20260811 01:35:55.354323 11038 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:55.355151 11038 heartbeater.cc:511] Master 127.23.39.254:37173 requested a full tablet report, sending...
I20260811 01:35:55.357554 10834 ts_manager.cc:194] Registered new tserver with Master: 16a390829b504d2594b23fc34df4b185 (127.23.39.193:42029)
I20260811 01:35:55.359285 10834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:50739
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:35:55.414075 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:55.772202 11047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:55.772571 11047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:55.772746 11047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:55.780503 11047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:55.780669 11047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:55.780860 11047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:35:55.791965 11047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:55.793358 11047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:55.794798 11047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:55.808593 11052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:55.808477 11053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:55.808429 11055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:55.809862 11047 server_base.cc:1034] running on GCE node
I20260811 01:35:55.810665 11047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:55.811678 11047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:55.812918 11047 hybrid_clock.cc:648] HybridClock initialized: now 1786412155812864 us; error 65 us; skew 500 ppm
I20260811 01:35:55.813263 11047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:55 dist-test-slave-9jjr krb5kdc[10783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412155, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:55.816710 11047 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:35:55.818436 11047 webserver.cc:460] Webserver started at http://127.23.39.194:33755/ using document root <none> and password file <none>
I20260811 01:35:55.819178 11047 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:55.819332 11047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:55.819690 11047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:55.823014 11047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "4b82f9c01583452795c14f45723e2c32"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "9bc7168c0129fb139337ac02ad4933a8"
server_key_iv: "fcb9c39005e5a5c2add2d2be6e557d90"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.823894 11047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "4b82f9c01583452795c14f45723e2c32"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "9bc7168c0129fb139337ac02ad4933a8"
server_key_iv: "fcb9c39005e5a5c2add2d2be6e557d90"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.829731 11047 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 01:35:55.833648 11064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.835289 11047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:35:55.835474 11047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "4b82f9c01583452795c14f45723e2c32"
format_stamp: "Formatted at 2026-08-11 01:35:55 on dist-test-slave-9jjr"
server_key: "9bc7168c0129fb139337ac02ad4933a8"
server_key_iv: "fcb9c39005e5a5c2add2d2be6e557d90"
server_key_version: "encryptionkey@0"
I20260811 01:35:55.835685 11047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:55.852144 11047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:55.856663 11047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:55.857048 11047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:55.858242 11047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:55.859716 11047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:55.859797 11047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.859934 11047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:55.859998 11047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:55.893983 11047 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:39067
I20260811 01:35:55.894017 11188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:39067 every 8 connection(s)
I20260811 01:35:55.895399 11047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:35:55.898319 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11047
I20260811 01:35:55.898545 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:35:55.899061 23711 external_mini_cluster.cc:1428] Setting key b1ed3ca62b03d139b91d862887631982
Aug 11 01:35:55 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412155, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:55.919064 11191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:55.898108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:59837 (local address 127.23.39.254:37173)
0811 01:35:55.898720 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:55.898726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:55.899753 (+ 1027us) server_negotiation.cc:407] Connection header received
0811 01:35:55.901862 (+ 2109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:55.901868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:55.901967 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:55.902093 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:55.904491 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.905215 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.907811 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.908260 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.908363 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:55.912811 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:55.912816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:55.912819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:55.912855 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:55.915553 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:55.916355 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:55.916360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:55.916362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:55.916495 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:55.917041 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:55.917045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:55.917047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:55.917382 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:55.917506 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:55.918533 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0811 01:35:55.918760 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":276,"threads_started":1}
I20260811 01:35:55.920611 11193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:55.898743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:37173 (local address 127.23.39.194:59837)
0811 01:35:55.899567 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:55.899622 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:55.901518 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:55.902490 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:55.902504 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:55.903375 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:55.904273 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:55.904304 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.905428 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.905437 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:55.907628 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:55.907646 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:55.908513 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:55.908522 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:55.908875 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:55.909660 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:55.909703 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:55.912530 (+ 2827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:55.915722 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:55.915734 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:55.915752 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:55.916210 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:55.916630 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:55.916635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:55.916639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:55.916877 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:55.917522 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:55.917533 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:55.918024 (+ 491us) client_negotiation.cc:769] Sending connection context
0811 01:35:55.918382 (+ 358us) client_negotiation.cc:240] Negotiation successful
0811 01:35:55.919005 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":304,"threads_started":1}
I20260811 01:35:55.922361 11189 heartbeater.cc:347] Connected to a master server at 127.23.39.254:37173
I20260811 01:35:55.922706 11189 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:55.923718 11189 heartbeater.cc:511] Master 127.23.39.254:37173 requested a full tablet report, sending...
I20260811 01:35:55.925467 10834 ts_manager.cc:194] Registered new tserver with Master: 4b82f9c01583452795c14f45723e2c32 (127.23.39.194:39067)
I20260811 01:35:55.926497 10834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:59837
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:35:55.978518 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:35:56.334882 11197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:56.335192 11197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:56.335369 11197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:56.343132 11197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:56.343292 11197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:56.343494 11197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:35:56.353660 11197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:37173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:56.355098 11197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:56.356448 11197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:35:56.362711 11038 heartbeater.cc:503] Master 127.23.39.254:37173 was elected leader, sending a full tablet report...
W20260811 01:35:56.370674 11204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:56.370640 11206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:56.370625 11203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:56.371543 11197 server_base.cc:1034] running on GCE node
I20260811 01:35:56.372180 11197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:56.373164 11197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:56.374395 11197 hybrid_clock.cc:648] HybridClock initialized: now 1786412156374331 us; error 60 us; skew 500 ppm
I20260811 01:35:56.374715 11197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:35:56 dist-test-slave-9jjr krb5kdc[10783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412156, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:35:56.384083 11197 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:35:56.385776 11197 webserver.cc:460] Webserver started at http://127.23.39.195:35335/ using document root <none> and password file <none>
I20260811 01:35:56.386606 11197 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:56.386765 11197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:56.387100 11197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:56.390556 11197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "69d3859dfacd400b9ed896d78f238a7c"
format_stamp: "Formatted at 2026-08-11 01:35:56 on dist-test-slave-9jjr"
server_key: "de4ca5398bc00d272051f2df03f8cbaa"
server_key_iv: "0f80263c2b74402204f76d8f52966fd1"
server_key_version: "encryptionkey@0"
I20260811 01:35:56.391369 11197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "69d3859dfacd400b9ed896d78f238a7c"
format_stamp: "Formatted at 2026-08-11 01:35:56 on dist-test-slave-9jjr"
server_key: "de4ca5398bc00d272051f2df03f8cbaa"
server_key_iv: "0f80263c2b74402204f76d8f52966fd1"
server_key_version: "encryptionkey@0"
I20260811 01:35:56.396780 11197 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 01:35:56.400426 11213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:56.401841 11197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:35:56.402040 11197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "69d3859dfacd400b9ed896d78f238a7c"
format_stamp: "Formatted at 2026-08-11 01:35:56 on dist-test-slave-9jjr"
server_key: "de4ca5398bc00d272051f2df03f8cbaa"
server_key_iv: "0f80263c2b74402204f76d8f52966fd1"
server_key_version: "encryptionkey@0"
I20260811 01:35:56.402318 11197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:56.430070 11197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:56.434832 11197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:56.435102 11197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:56.436100 11197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:56.437510 11197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:56.437590 11197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:56.437680 11197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:56.437724 11197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:56.473641 11197 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:46377
I20260811 01:35:56.473732 11340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:46377 every 8 connection(s)
I20260811 01:35:56.474992 11197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:35:56.483502 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11197
I20260811 01:35:56.483714 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:35:56.484162 23711 external_mini_cluster.cc:1428] Setting key f4668f13a1ea270d0a7bd8f529d2e180
Aug 11 01:35:56 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412156, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:35:56.497313 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.477857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:40363 (local address 127.23.39.254:37173)
0811 01:35:56.478391 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.478396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.479454 (+ 1058us) server_negotiation.cc:407] Connection header received
0811 01:35:56.481407 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.481412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.481521 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.481653 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:56.483491 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.484451 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.486287 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.486767 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.486908 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.490973 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:56.490979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:56.490983 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:56.491019 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:56.494109 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:56.494913 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:56.494917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:56.494920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:56.495052 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:56.495474 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:56.495478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:56.495480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:56.495789 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:56.495921 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.496667 (+ 746us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.496905 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":244,"threads_started":1}
I20260811 01:35:56.498798 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.478456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:37173 (local address 127.23.39.195:40363)
0811 01:35:56.479241 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.479299 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.481129 (+ 1830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.481879 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.481888 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.482511 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:56.483266 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.483297 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.484626 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.484632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.486093 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.486112 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.487008 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.487016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.487298 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.488115 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:35:56.488179 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:56.490742 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:56.494328 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:56.494335 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:56.494348 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:56.494786 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:56.495160 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:35:56.495165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:35:56.495168 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:35:56.495350 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:35:56.495907 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:56.495913 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:56.496236 (+ 323us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.496549 (+ 313us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.497099 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":349,"threads_started":1}
I20260811 01:35:56.500299 11341 heartbeater.cc:347] Connected to a master server at 127.23.39.254:37173
I20260811 01:35:56.500663 11341 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:56.501353 11341 heartbeater.cc:511] Master 127.23.39.254:37173 requested a full tablet report, sending...
I20260811 01:35:56.502921 10834 ts_manager.cc:194] Registered new tserver with Master: 69d3859dfacd400b9ed896d78f238a7c (127.23.39.195:46377)
I20260811 01:35:56.503749 10834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:40363
I20260811 01:35:56.513072 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:35:56.531880 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.518074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37128 (local address 127.23.39.254:37173)
0811 01:35:56.518427 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.518435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.518766 (+ 331us) server_negotiation.cc:407] Connection header received
0811 01:35:56.518966 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.518970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.519055 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.519148 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:56.520692 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.521448 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.522965 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.523418 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.523546 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.526067 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:56.526072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:56.526075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:56.526111 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:56.528872 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:56.529644 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:56.529648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:56.529651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:56.529775 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:56.530280 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:56.530285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:56.530288 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:56.530649 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:56.530864 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.531307 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.531547 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:35:56.536227 10834 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:35:56.543493 10834 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:35:56.568969 11354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.556123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39067 (local address 127.0.0.1:32784)
0811 01:35:56.556941 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.557003 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.557215 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.558649 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.558656 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.558688 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:56.559151 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.559163 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.562773 (+ 3610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.562779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.565687 (+ 2908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.565701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.567681 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.567689 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.567954 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.568032 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.568192 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.568413 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":16,"thread_start_us":305,"threads_started":1}
I20260811 01:35:56.569120 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.556777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47290)
0811 01:35:56.558713 (+ 1936us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.558732 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.558878 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.559825 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.559832 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.559860 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:56.560289 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.560300 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.562773 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.562779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.566250 (+ 3471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.566266 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.568238 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.568244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.568420 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.568454 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.568548 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.568688 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1816,"mutex_wait_us":1,"thread_start_us":6694,"threads_started":1}
I20260811 01:35:56.569041 11355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.556282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32784 (local address 127.23.39.194:39067)
0811 01:35:56.557905 (+ 1623us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.557917 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.557950 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:35:56.558070 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.558077 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.558372 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.559396 (+ 1024us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:56.559642 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.562578 (+ 2936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.565876 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.567380 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.567603 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.567890 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.568512 (+ 622us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.568692 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1440,"thread_start_us":1302,"threads_started":1}
I20260811 01:35:56.570001 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.557401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47290 (local address 127.23.39.193:42029)
0811 01:35:56.558303 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.558311 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.559004 (+ 693us) server_negotiation.cc:407] Connection header received
0811 01:35:56.559109 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.559118 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.559355 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.559536 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:56.560507 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.562614 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.566447 (+ 3833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.567980 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.568125 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.568378 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.569457 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.569619 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":578,"threads_started":1}
I20260811 01:35:56.572762 11356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.557291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46377 (local address 127.0.0.1:37546)
0811 01:35:56.563795 (+ 6504us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.563819 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.563954 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.564954 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.564960 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.564990 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:56.565480 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.565493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.567605 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.567611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.569932 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.569945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.571922 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.571929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.572115 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.572149 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.572245 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.572371 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6355,"mutex_wait_us":1,"thread_start_us":1353,"threads_started":1}
I20260811 01:35:56.572932 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.558317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.23.39.195:46377)
0811 01:35:56.564289 (+ 5972us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.564299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.564338 (+ 39us) server_negotiation.cc:407] Connection header received
0811 01:35:56.564442 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.564450 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.564730 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.564937 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:56.565714 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.567414 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.570215 (+ 2801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.571690 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.571854 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.572088 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.572308 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.572467 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5747,"thread_start_us":6268,"threads_started":1}
I20260811 01:35:56.573853 10968 tablet_service.cc:1467] Processing CreateTablet for tablet ac3f462c693741919d3a798e1149cdb8 (DEFAULT_TABLE table=test-table [id=e9e886508fd8491aade3cc48762132da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:56.573817 11118 tablet_service.cc:1467] Processing CreateTablet for tablet ac3f462c693741919d3a798e1149cdb8 (DEFAULT_TABLE table=test-table [id=e9e886508fd8491aade3cc48762132da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:56.575246 10968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3f462c693741919d3a798e1149cdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:56.575299 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3f462c693741919d3a798e1149cdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:56.576965 11266 tablet_service.cc:1467] Processing CreateTablet for tablet ac3f462c693741919d3a798e1149cdb8 (DEFAULT_TABLE table=test-table [id=e9e886508fd8491aade3cc48762132da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:56.578584 11266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3f462c693741919d3a798e1149cdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:56.587569 11361 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Bootstrap starting.
I20260811 01:35:56.591352 11362 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Bootstrap starting.
I20260811 01:35:56.592283 11361 tablet_bootstrap.cc:654] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:56.593680 11361 log.cc:824] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:56.594310 11363 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Bootstrap starting.
I20260811 01:35:56.595104 11362 tablet_bootstrap.cc:654] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:56.596321 11362 log.cc:824] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:56.597568 11361 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: No bootstrap required, opened a new log
I20260811 01:35:56.597620 11363 tablet_bootstrap.cc:654] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:56.597873 11361 ts_tablet_manager.cc:1397] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260811 01:35:56.598893 11363 log.cc:824] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:56.599653 11362 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: No bootstrap required, opened a new log
I20260811 01:35:56.599987 11362 ts_tablet_manager.cc:1397] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260811 01:35:56.605450 11363 tablet_bootstrap.cc:492] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: No bootstrap required, opened a new log
I20260811 01:35:56.605815 11363 ts_tablet_manager.cc:1397] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260811 01:35:56.606768 11361 raft_consensus.cc:348] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.607326 11361 raft_consensus.cc:374] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:56.607437 11361 raft_consensus.cc:729] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16a390829b504d2594b23fc34df4b185, State: Initialized, Role: FOLLOWER
I20260811 01:35:56.608076 11361 consensus_queue.cc:260] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.609936 11361 ts_tablet_manager.cc:1428] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260811 01:35:56.611583 11362 raft_consensus.cc:348] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.612051 11362 raft_consensus.cc:374] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:56.612154 11362 raft_consensus.cc:729] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b82f9c01583452795c14f45723e2c32, State: Initialized, Role: FOLLOWER
I20260811 01:35:56.612778 11362 consensus_queue.cc:260] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.613996 11189 heartbeater.cc:503] Master 127.23.39.254:37173 was elected leader, sending a full tablet report...
I20260811 01:35:56.614683 11362 ts_tablet_manager.cc:1428] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
I20260811 01:35:56.616897 11363 raft_consensus.cc:348] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.617300 11363 raft_consensus.cc:374] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:56.617412 11363 raft_consensus.cc:729] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d3859dfacd400b9ed896d78f238a7c, State: Initialized, Role: FOLLOWER
I20260811 01:35:56.618064 11363 consensus_queue.cc:260] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.619288 11341 heartbeater.cc:503] Master 127.23.39.254:37173 was elected leader, sending a full tablet report...
I20260811 01:35:56.619961 11363 ts_tablet_manager.cc:1428] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
W20260811 01:35:56.647598 11190 tablet.cc:2369] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:35:56.726971 11342 tablet.cc:2369] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:35:56.830405 11039 tablet.cc:2369] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:35:56.886046 11367 raft_consensus.cc:482] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:56.886394 11367 raft_consensus.cc:504] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.888343 11367 leader_election.cc:288] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b82f9c01583452795c14f45723e2c32 (127.23.39.194:39067), 69d3859dfacd400b9ed896d78f238a7c (127.23.39.195:46377)
I20260811 01:35:56.895910 11355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.888949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:33323 (local address 127.23.39.194:39067)
0811 01:35:56.889218 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.889225 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.889511 (+ 286us) server_negotiation.cc:407] Connection header received
0811 01:35:56.889789 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.889794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.889858 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.889949 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:56.890933 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.891663 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.893539 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.894946 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.895140 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.895240 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.895498 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.895635 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:35:56.895974 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.888613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:39067 (local address 127.23.39.193:33323)
0811 01:35:56.889369 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.889387 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.889579 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.890226 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.890230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.890259 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:56.890770 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.890782 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.891818 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.891824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.893323 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.893341 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.895156 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.895162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.895335 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.895359 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.895467 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.895603 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":417,"threads_started":1}
I20260811 01:35:56.897346 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.889933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:46157 (local address 127.23.39.195:46377)
0811 01:35:56.890277 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.890285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.890975 (+ 690us) server_negotiation.cc:407] Connection header received
0811 01:35:56.891171 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.891182 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.891250 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.891350 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:56.891895 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.892625 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.894932 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.896177 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.896341 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.896412 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.896925 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.897070 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:35:56.897331 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.889618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:46377 (local address 127.23.39.193:46157)
0811 01:35:56.890869 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:56.890884 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:56.891038 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:56.891365 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:56.891369 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:56.891392 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:56.891739 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.891748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.892772 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.892778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.894737 (+ 1959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:56.894755 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.896554 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.896572 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:56.896748 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.896779 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:35:56.896868 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:35:56.896995 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1126,"thread_start_us":880,"threads_started":1}
I20260811 01:35:56.897168 11142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3f462c693741919d3a798e1149cdb8" candidate_uuid: "16a390829b504d2594b23fc34df4b185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b82f9c01583452795c14f45723e2c32" is_pre_election: true
I20260811 01:35:56.897818 11142 raft_consensus.cc:2454] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a390829b504d2594b23fc34df4b185 in term 0.
I20260811 01:35:56.898506 11289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3f462c693741919d3a798e1149cdb8" candidate_uuid: "16a390829b504d2594b23fc34df4b185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d3859dfacd400b9ed896d78f238a7c" is_pre_election: true
I20260811 01:35:56.898787 10919 leader_election.cc:302] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a390829b504d2594b23fc34df4b185, 4b82f9c01583452795c14f45723e2c32; no voters:
I20260811 01:35:56.899057 11289 raft_consensus.cc:2454] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a390829b504d2594b23fc34df4b185 in term 0.
I20260811 01:35:56.899130 11367 raft_consensus.cc:2781] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:35:56.899257 11367 raft_consensus.cc:482] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:35:56.899327 11367 raft_consensus.cc:3037] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:56.901737 11367 raft_consensus.cc:504] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.902455 11367 leader_election.cc:288] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [CANDIDATE]: Term 1 election: Requested vote from peers 4b82f9c01583452795c14f45723e2c32 (127.23.39.194:39067), 69d3859dfacd400b9ed896d78f238a7c (127.23.39.195:46377)
I20260811 01:35:56.902948 11142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3f462c693741919d3a798e1149cdb8" candidate_uuid: "16a390829b504d2594b23fc34df4b185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b82f9c01583452795c14f45723e2c32"
I20260811 01:35:56.903046 11289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3f462c693741919d3a798e1149cdb8" candidate_uuid: "16a390829b504d2594b23fc34df4b185" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69d3859dfacd400b9ed896d78f238a7c"
I20260811 01:35:56.903204 11142 raft_consensus.cc:3037] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:56.903285 11289 raft_consensus.cc:3037] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:56.905635 11142 raft_consensus.cc:2454] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a390829b504d2594b23fc34df4b185 in term 1.
I20260811 01:35:56.906231 10919 leader_election.cc:302] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a390829b504d2594b23fc34df4b185, 4b82f9c01583452795c14f45723e2c32; no voters:
I20260811 01:35:56.906548 11367 raft_consensus.cc:2781] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:35:56.906711 11289 raft_consensus.cc:2454] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a390829b504d2594b23fc34df4b185 in term 1.
I20260811 01:35:56.907196 11367 raft_consensus.cc:686] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 1 LEADER]: Becoming Leader. State: Replica: 16a390829b504d2594b23fc34df4b185, State: Running, Role: LEADER
I20260811 01:35:56.907732 11367 consensus_queue.cc:237] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } }
I20260811 01:35:56.912601 10834 catalog_manager.cc:5495] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16a390829b504d2594b23fc34df4b185 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "16a390829b504d2594b23fc34df4b185" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16a390829b504d2594b23fc34df4b185" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 42029 } health_report { overall_health: HEALTHY } } }
I20260811 01:35:56.941548 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.934968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47294 (local address 127.23.39.193:42029)
0811 01:35:56.935357 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.935362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:56.935391 (+ 29us) server_negotiation.cc:407] Connection header received
0811 01:35:56.935490 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:56.935494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:56.935601 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:56.935753 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:35:56.936222 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.937179 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.938949 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:56.939453 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:56.939558 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:56.940184 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:35:56.940806 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:35:56.940919 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:56.941133 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 01:35:56.941216 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 01:35:56.950793 11289 raft_consensus.cc:1261] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 1 FOLLOWER]: Refusing update from remote peer 16a390829b504d2594b23fc34df4b185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:35:56.950789 11142 raft_consensus.cc:1261] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 1 FOLLOWER]: Refusing update from remote peer 16a390829b504d2594b23fc34df4b185: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:35:56.951859 11374 consensus_queue.cc:1035] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b82f9c01583452795c14f45723e2c32" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 39067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:35:56.952286 11367 consensus_queue.cc:1035] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69d3859dfacd400b9ed896d78f238a7c" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 46377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:35:56.979770 10833 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:35:56.980131 10833 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:35:56.983942 10833 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29a0bdec141c4661997a1479c45cad1f: Sending DeleteTablet for 3 replicas of tablet ac3f462c693741919d3a798e1149cdb8
I20260811 01:35:56.985188 10968 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3f462c693741919d3a798e1149cdb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:56 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:47290
I20260811 01:35:56.985282 11266 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3f462c693741919d3a798e1149cdb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:56 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:37546
I20260811 01:35:56.985550 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3f462c693741919d3a798e1149cdb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:35:56 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:32784
I20260811 01:35:56.987366 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 10902
I20260811 01:35:56.997036 11393 tablet_replica.cc:330] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: stopping tablet replica
I20260811 01:35:56.997674 11393 raft_consensus.cc:2229] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:35:56.998392 11393 raft_consensus.cc:2258] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:35:56.999509 11389 tablet_replica.cc:330] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: stopping tablet replica
I20260811 01:35:57.000057 11389 raft_consensus.cc:2229] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:35:57.000952 11389 raft_consensus.cc:2258] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:35:57.003979 11393 ts_tablet_manager.cc:1905] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:35:57.008934 11389 ts_tablet_manager.cc:1905] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:35:57.010659 11390 tablet_replica.cc:330] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: stopping tablet replica
I20260811 01:35:57.011080 11390 raft_consensus.cc:2229] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:35:57.011591 11390 raft_consensus.cc:2258] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 11 01:35:57 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:35:57.013818 11390 ts_tablet_manager.cc:1905] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:35:57.022179 11390 ts_tablet_manager.cc:1918] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:35:57.022488 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:56.989278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47300 (local address 127.23.39.193:42029)
0811 01:35:56.989518 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:56.989527 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:57.000298 (+ 10771us) server_negotiation.cc:407] Connection header received
0811 01:35:57.000633 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:57.000641 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:57.000736 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:57.000828 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:57.002968 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.004253 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.006492 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.007333 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.007439 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:57.013555 (+ 6116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:57.013573 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:57.013591 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:57.013648 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:57.018249 (+ 4601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.019345 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.019356 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.019361 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.019584 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.020139 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.020145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.020149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.020646 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:57.020921 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:57.021630 (+ 709us) server_negotiation.cc:299] Negotiation successful
0811 01:35:57.021925 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:35:57.022508 11390 log.cc:1196] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/ac3f462c693741919d3a798e1149cdb8
I20260811 01:35:57.023803 11390 ts_tablet_manager.cc:1939] T ac3f462c693741919d3a798e1149cdb8 P 69d3859dfacd400b9ed896d78f238a7c: Deleting consensus metadata
I20260811 01:35:57.024231 11033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:57.025532 11393 ts_tablet_manager.cc:1918] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:35:57.025830 11393 log.cc:1196] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/ac3f462c693741919d3a798e1149cdb8
I20260811 01:35:57.026954 11393 ts_tablet_manager.cc:1939] T ac3f462c693741919d3a798e1149cdb8 P 4b82f9c01583452795c14f45723e2c32: Deleting consensus metadata
I20260811 01:35:57.028136 10813 catalog_manager.cc:4841] TS 69d3859dfacd400b9ed896d78f238a7c (127.23.39.195:46377): tablet ac3f462c693741919d3a798e1149cdb8 (table test-table [id=e9e886508fd8491aade3cc48762132da]) successfully deleted
I20260811 01:35:57.028879 10813 catalog_manager.cc:4841] TS 4b82f9c01583452795c14f45723e2c32 (127.23.39.194:39067): tablet ac3f462c693741919d3a798e1149cdb8 (table test-table [id=e9e886508fd8491aade3cc48762132da]) successfully deleted
I20260811 01:35:57.124557 11389 ts_tablet_manager.cc:1918] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:35:57.124863 11389 log.cc:1196] T ac3f462c693741919d3a798e1149cdb8 P 16a390829b504d2594b23fc34df4b185: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/ac3f462c693741919d3a798e1149cdb8
I20260811 01:35:57.125413 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 10902
I20260811 01:35:57.148815 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11047
W20260811 01:35:57.148775 10815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:42029 (error 108)
I20260811 01:35:57.151018 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.150202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47304)
0811 01:35:57.150650 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.150789 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":195,"threads_started":1}
W20260811 01:35:57.151345 10815 catalog_manager.cc:4584] TS 16a390829b504d2594b23fc34df4b185 (127.23.39.193:42029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac3f462c693741919d3a798e1149cdb8: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Aug 11 01:35:57 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:35:57.166175 11355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.149665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.23.39.194:39067)
0811 01:35:57.149865 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:57.149869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:57.150012 (+ 143us) server_negotiation.cc:407] Connection header received
0811 01:35:57.150229 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:57.150234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:57.150348 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:57.150475 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:57.152065 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.152828 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.154690 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.155115 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.155236 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:57.160029 (+ 4793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:57.160047 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:57.160064 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:57.160109 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:57.162998 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.163849 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.163858 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.163860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.164008 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.164434 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.164439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.164442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.164861 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:57.165180 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:57.165505 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 01:35:57.165755 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:35:57.166839 11184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:57.205309 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.204811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47318)
0811 01:35:57.205051 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.205161 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:35:57.206597 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.206106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47332)
0811 01:35:57.206330 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.206420 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 01:35:57.261060 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11047
I20260811 01:35:57.267098 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.266626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47334)
0811 01:35:57.266848 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.266945 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 01:35:57.268369 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.268013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47340)
0811 01:35:57.268154 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.268225 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 01:35:57.282166 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11197
Aug 11 01:35:57 dist-test-slave-9jjr krb5kdc[10783](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:35:57.299222 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.282954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.23.39.195:46377)
0811 01:35:57.283134 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:57.283139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:57.283158 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:35:57.283269 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:57.283273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:57.283339 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:57.283427 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:57.284784 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.285541 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.287094 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:57.287512 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:57.287619 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:57.292989 (+ 5370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:57.293008 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:57.293022 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:35:57.293070 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:57.296294 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.297048 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.297055 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.297057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.297222 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:35:57.297648 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:35:57.297652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:35:57.297654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:35:57.298031 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:57.298396 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:57.298751 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 01:35:57.298927 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 01:35:57.299861 11335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:57.349299 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.348805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47348)
0811 01:35:57.349048 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.349139 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 01:35:57.350526 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.350054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47362)
0811 01:35:57.350307 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.350377 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260811 01:35:57.391973 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11197
I20260811 01:35:57.412400 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 10797
I20260811 01:35:57.413712 10867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:35:57.528035 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 10797
I20260811 01:35:57.528115 11398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:57.527496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:42029 (local address 127.0.0.1:47370)
0811 01:35:57.527771 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:57.527928 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:42029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
2026-08-11T01:35:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4948 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T01:35:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:35:57Z Disabled control of system clock
I20260811 01:35:57.625622 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33611
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:33461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:33611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:35:57.984828 11405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:57.985150 11405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:57.985247 11405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:57.992805 11405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:35:57.992933 11405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:57.992971 11405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:57.993022 11405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:35:57.993072 11405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:35:58.002679 11405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:33611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:58.004113 11405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:58.005908 11405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:58.018626 11411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:58.018697 11412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:58.018927 11414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:58.019801 11405 server_base.cc:1034] running on GCE node
I20260811 01:35:58.020792 11405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:58.022445 11405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:58.023665 11405 hybrid_clock.cc:648] HybridClock initialized: now 1786412158023600 us; error 75 us; skew 500 ppm
I20260811 01:35:58.024053 11405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:35:58.026669 11405 webserver.cc:460] Webserver started at http://127.23.39.254:40341/ using document root <none> and password file <none>
I20260811 01:35:58.027423 11405 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:58.027567 11405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:58.027926 11405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:58.031141 11405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "4a323528d2bb45edaf2b8f92b97edd07"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "a195b045d67462dd462efa30f94266f1"
server_key_iv: "27a9c7e8b41ca42e137c46819ba0aa94"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.032027 11405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "4a323528d2bb45edaf2b8f92b97edd07"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "a195b045d67462dd462efa30f94266f1"
server_key_iv: "27a9c7e8b41ca42e137c46819ba0aa94"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.037830 11405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:35:58.041698 11420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:58.043447 11405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 01:35:58.043668 11405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "4a323528d2bb45edaf2b8f92b97edd07"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "a195b045d67462dd462efa30f94266f1"
server_key_iv: "27a9c7e8b41ca42e137c46819ba0aa94"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.043939 11405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:58.071920 11405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:58.072892 11405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:58.073231 11405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:58.093142 11405 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:33611
I20260811 01:35:58.093175 11481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:33611 every 8 connection(s)
I20260811 01:35:58.094688 11405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:35:58.098706 11482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:58.099707 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11405
I20260811 01:35:58.099912 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:35:58.100411 23711 external_mini_cluster.cc:1428] Setting key 8bbf9a6ffc5e48f76c04d01ad3684cdb
I20260811 01:35:58.112172 11482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: Bootstrap starting.
I20260811 01:35:58.114784 11485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:58.102471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38716 (local address 127.23.39.254:33611)
0811 01:35:58.103780 (+ 1309us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:58.103792 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:58.103852 (+ 60us) server_negotiation.cc:407] Connection header received
0811 01:35:58.105503 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:58.105527 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:58.106005 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:58.106538 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:58.107116 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.108394 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.110028 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.110784 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.110989 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:58.112332 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:58.112345 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:58.112367 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:35:58.112930 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:58.113018 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:35:58.113039 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:58.113195 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:58.113415 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 01:35:58.113742 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":802,"thread_start_us":555,"threads_started":1}
I20260811 01:35:58.115823 11482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:58.116918 11482 log.cc:824] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:58.119765 11482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: No bootstrap required, opened a new log
I20260811 01:35:58.127153 11482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } }
I20260811 01:35:58.127578 11482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:58.127691 11482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a323528d2bb45edaf2b8f92b97edd07, State: Initialized, Role: FOLLOWER
I20260811 01:35:58.128286 11482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } }
I20260811 01:35:58.128541 11482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:35:58.128691 11482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:35:58.128871 11482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:58.131225 11482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } }
I20260811 01:35:58.131786 11482 leader_election.cc:302] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a323528d2bb45edaf2b8f92b97edd07; no voters:
I20260811 01:35:58.132438 11482 leader_election.cc:288] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:35:58.132617 11487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:35:58.133442 11487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [term 1 LEADER]: Becoming Leader. State: Replica: 4a323528d2bb45edaf2b8f92b97edd07, State: Running, Role: LEADER
I20260811 01:35:58.133982 11487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } }
I20260811 01:35:58.134732 11482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:35:58.137001 11489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a323528d2bb45edaf2b8f92b97edd07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } } }
I20260811 01:35:58.137468 11489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:58.137383 11490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a323528d2bb45edaf2b8f92b97edd07. Latest consensus state: current_term: 1 leader_uuid: "4a323528d2bb45edaf2b8f92b97edd07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a323528d2bb45edaf2b8f92b97edd07" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33611 } } }
I20260811 01:35:58.137719 11490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07 [sys.catalog]: This master's current role is: LEADER
I20260811 01:35:58.140507 11494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:35:58.146196 11494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:35:58.156086 11494 catalog_manager.cc:1347] Generated new cluster ID: 63006f18c554427297f8d39070f885c3
I20260811 01:35:58.156224 11494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:35:58.171268 11494 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:35:58.172574 11494 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:35:58.181458 11494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: Generated new TSK 0
I20260811 01:35:58.182384 11494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:35:58.192126 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--builtin_ntp_servers=127.23.39.212:33461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:35:58.552601 11509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:58.552973 11509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:58.553141 11509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:58.560953 11509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:58.561118 11509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:58.561313 11509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:35:58.570672 11509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:58.572077 11509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:58.573976 11509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:58.587798 11517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:58.587774 11515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:58.587777 11514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:58.591576 11509 server_base.cc:1034] running on GCE node
I20260811 01:35:58.592276 11509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:58.593303 11509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:58.594540 11509 hybrid_clock.cc:648] HybridClock initialized: now 1786412158594469 us; error 69 us; skew 500 ppm
I20260811 01:35:58.594873 11509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:35:58.597293 11509 webserver.cc:460] Webserver started at http://127.23.39.193:35499/ using document root <none> and password file <none>
I20260811 01:35:58.598047 11509 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:58.598212 11509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:58.598552 11509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:58.601579 11509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "b91c53403bf640dca7b939fae925fb85"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "1911193e09023769d1c8d66bb348ef70"
server_key_iv: "cb6f3520b76f62a6a9fbeae906b1e129"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.602468 11509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "b91c53403bf640dca7b939fae925fb85"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "1911193e09023769d1c8d66bb348ef70"
server_key_iv: "cb6f3520b76f62a6a9fbeae906b1e129"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.607930 11509 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:35:58.611661 11526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:58.613243 11509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:35:58.613456 11509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "b91c53403bf640dca7b939fae925fb85"
format_stamp: "Formatted at 2026-08-11 01:35:58 on dist-test-slave-9jjr"
server_key: "1911193e09023769d1c8d66bb348ef70"
server_key_iv: "cb6f3520b76f62a6a9fbeae906b1e129"
server_key_version: "encryptionkey@0"
I20260811 01:35:58.613708 11509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:58.643484 11509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:58.644376 11509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:58.644666 11509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:58.645721 11509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:58.648025 11509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:58.648141 11509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:58.648280 11509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:58.648375 11509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:58.689177 11509 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:44813
I20260811 01:35:58.689386 11650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:44813 every 8 connection(s)
I20260811 01:35:58.690636 11509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:35:58.699018 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11509
I20260811 01:35:58.699198 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:35:58.704141 23711 external_mini_cluster.cc:1428] Setting key 333b331423281d43fbe2fc419962c55a
I20260811 01:35:58.704461 11653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:58.693298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:49069 (local address 127.23.39.254:33611)
0811 01:35:58.693789 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:58.693797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:58.695110 (+ 1313us) server_negotiation.cc:407] Connection header received
0811 01:35:58.696974 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:58.696980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:58.697083 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:58.697217 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:58.698425 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.699577 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.701190 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.701907 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.702059 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:58.703533 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:58.703540 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:58.703545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:35:58.703571 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:58.703621 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:35:58.703638 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:58.703736 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:58.703967 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 01:35:58.704073 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":253,"threads_started":1}
I20260811 01:35:58.705631 11654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:58.693948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33611 (local address 127.23.39.193:49069)
0811 01:35:58.694933 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:58.694977 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:58.696690 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:58.697459 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:58.697468 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:58.697605 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:58.698250 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:58.698275 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.699765 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.699769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:58.701034 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:58.701048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:58.702193 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:58.702200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:58.702411 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:58.703168 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:35:58.703171 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:58.703219 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:35:58.703301 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:58.703743 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:58.703752 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:58.703758 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:35:58.703906 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 01:35:58.704248 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":345,"threads_started":1}
I20260811 01:35:58.707314 11651 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33611
I20260811 01:35:58.707417 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--builtin_ntp_servers=127.23.39.212:33461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:35:58.707679 11651 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:58.708479 11651 heartbeater.cc:511] Master 127.23.39.254:33611 requested a full tablet report, sending...
I20260811 01:35:58.710728 11441 ts_manager.cc:194] Registered new tserver with Master: b91c53403bf640dca7b939fae925fb85 (127.23.39.193:44813)
I20260811 01:35:58.712229 11441 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.193:49069
W20260811 01:35:59.067624 11655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:59.067937 11655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:59.068091 11655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:59.075911 11655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:59.076030 11655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:59.076246 11655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:35:59.085974 11655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:59.087347 11655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:59.089207 11655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:59.103709 11662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:59.103969 11665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:59.104256 11660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:59.105324 11655 server_base.cc:1034] running on GCE node
I20260811 01:35:59.106027 11655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:59.107288 11655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:59.108546 11655 hybrid_clock.cc:648] HybridClock initialized: now 1786412159108474 us; error 58 us; skew 500 ppm
I20260811 01:35:59.108913 11655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:35:59.111704 11655 webserver.cc:460] Webserver started at http://127.23.39.194:45571/ using document root <none> and password file <none>
I20260811 01:35:59.112591 11655 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:59.112717 11655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:59.113075 11655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:59.116135 11655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "4c8435f761364152bb345e94822938ef"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "b7b0f9dead152c24183fc536839c53a7"
server_key_iv: "d40fd534259494e500a2ff1756ca38e9"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.116881 11655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "4c8435f761364152bb345e94822938ef"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "b7b0f9dead152c24183fc536839c53a7"
server_key_iv: "d40fd534259494e500a2ff1756ca38e9"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.122529 11655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260811 01:35:59.126027 11671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.127539 11655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:35:59.127735 11655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "4c8435f761364152bb345e94822938ef"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "b7b0f9dead152c24183fc536839c53a7"
server_key_iv: "d40fd534259494e500a2ff1756ca38e9"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.127969 11655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:59.141505 11655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:59.142508 11655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:59.142839 11655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:59.143874 11655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:59.145440 11655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:59.145570 11655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.145720 11655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:59.145812 11655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.180873 11655 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:32811
I20260811 01:35:59.180934 11799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:32811 every 8 connection(s)
I20260811 01:35:59.182413 11655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:35:59.182933 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11655
I20260811 01:35:59.183151 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:35:59.183816 23711 external_mini_cluster.cc:1428] Setting key 9d9ad3f4873f060e3215ef1ca9b6798d
I20260811 01:35:59.187489 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--builtin_ntp_servers=127.23.39.212:33461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:35:59.196420 11653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.185807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:40483 (local address 127.23.39.254:33611)
0811 01:35:59.186000 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.186006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.187680 (+ 1674us) server_negotiation.cc:407] Connection header received
0811 01:35:59.189604 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.189609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.189703 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.189817 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:59.190996 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.191733 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.193449 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.193868 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.194013 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.195542 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:59.195547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:59.195550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:35:59.195580 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:59.195614 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:35:59.195625 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:59.195726 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.195969 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.196080 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 01:35:59.197517 11802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.186514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33611 (local address 127.23.39.194:40483)
0811 01:35:59.187499 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.187544 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.189318 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.190074 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.190083 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.190231 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:59.190815 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.190832 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.191903 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.191913 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.193296 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.193309 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.194164 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.194175 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.194399 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.195206 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:35:59.195208 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:59.195249 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:35:59.195333 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:59.195726 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:59.195741 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:59.195752 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.195941 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.196380 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":333,"threads_started":1}
I20260811 01:35:59.199215 11800 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33611
I20260811 01:35:59.199539 11800 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:59.200320 11800 heartbeater.cc:511] Master 127.23.39.254:33611 requested a full tablet report, sending...
I20260811 01:35:59.201848 11441 ts_manager.cc:194] Registered new tserver with Master: 4c8435f761364152bb345e94822938ef (127.23.39.194:32811)
I20260811 01:35:59.202778 11441 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.194:40483
W20260811 01:35:59.544440 11804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:35:59.544775 11804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:35:59.544936 11804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:35:59.552538 11804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:35:59.552686 11804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:35:59.552876 11804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:35:59.562254 11804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:33611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:35:59.563639 11804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:35:59.565526 11804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:35:59.579104 11810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:59.579183 11812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:35:59.579205 11814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:35:59.583649 11804 server_base.cc:1034] running on GCE node
I20260811 01:35:59.584339 11804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:35:59.585363 11804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:35:59.586603 11804 hybrid_clock.cc:648] HybridClock initialized: now 1786412159586562 us; error 55 us; skew 500 ppm
I20260811 01:35:59.586935 11804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:35:59.589327 11804 webserver.cc:460] Webserver started at http://127.23.39.195:34911/ using document root <none> and password file <none>
I20260811 01:35:59.590037 11804 fs_manager.cc:359] Metadata directory not provided
I20260811 01:35:59.590204 11804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:35:59.590539 11804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:35:59.593570 11804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "cfd07b09953a4f1ea919320e2f2e5bb8"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "c2965e36f98f4ed1e60e17260056cf5e"
server_key_iv: "7878a015005e754c37a5a836e089883a"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.594475 11804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "cfd07b09953a4f1ea919320e2f2e5bb8"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "c2965e36f98f4ed1e60e17260056cf5e"
server_key_iv: "7878a015005e754c37a5a836e089883a"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.599815 11804 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 01:35:59.603327 11821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.604710 11804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:35:59.604898 11804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "cfd07b09953a4f1ea919320e2f2e5bb8"
format_stamp: "Formatted at 2026-08-11 01:35:59 on dist-test-slave-9jjr"
server_key: "c2965e36f98f4ed1e60e17260056cf5e"
server_key_iv: "7878a015005e754c37a5a836e089883a"
server_key_version: "encryptionkey@0"
I20260811 01:35:59.605141 11804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:35:59.616814 11804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:35:59.617689 11804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:35:59.618036 11804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:35:59.619191 11804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:35:59.620695 11804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:35:59.620826 11804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.620956 11804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:35:59.621044 11804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:35:59.656682 11804 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:45359
I20260811 01:35:59.656733 11950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:45359 every 8 connection(s)
I20260811 01:35:59.658154 11804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:35:59.662863 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 11804
I20260811 01:35:59.663118 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:35:59.663826 23711 external_mini_cluster.cc:1428] Setting key e8bc741cd3a564fbcc243d0c2a7ce574
I20260811 01:35:59.671653 11653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.660895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:40109 (local address 127.23.39.254:33611)
0811 01:35:59.661078 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.661083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.662602 (+ 1519us) server_negotiation.cc:407] Connection header received
0811 01:35:59.664726 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.664732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.664833 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.664961 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:59.666248 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.667154 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.668785 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.669191 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.669328 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.670797 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:59.670802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:59.670805 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:35:59.670825 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:59.670856 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:35:59.670867 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:59.670967 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.671214 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.671312 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:35:59.672646 11953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.661420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:33611 (local address 127.23.39.195:40109)
0811 01:35:59.662427 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.662471 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.664391 (+ 1920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.665214 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.665228 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.665344 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:35:59.666045 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.666063 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.667326 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.667330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.668621 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.668634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.669420 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.669428 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.669661 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.670427 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:35:59.670429 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:35:59.670475 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:35:59.670554 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:35:59.670968 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:35:59.670983 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:35:59.670993 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.671182 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.671587 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":313,"threads_started":1}
I20260811 01:35:59.674062 11951 heartbeater.cc:347] Connected to a master server at 127.23.39.254:33611
I20260811 01:35:59.674474 11951 heartbeater.cc:464] Registering TS with master...
I20260811 01:35:59.675261 11951 heartbeater.cc:511] Master 127.23.39.254:33611 requested a full tablet report, sending...
I20260811 01:35:59.676645 11441 ts_manager.cc:194] Registered new tserver with Master: cfd07b09953a4f1ea919320e2f2e5bb8 (127.23.39.195:45359)
I20260811 01:35:59.677636 11441 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.195:40109
I20260811 01:35:59.679548 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:35:59.689560 11653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.683746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38722 (local address 127.23.39.254:33611)
0811 01:35:59.683947 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.683951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.684382 (+ 431us) server_negotiation.cc:407] Connection header received
0811 01:35:59.684543 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.684550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.684619 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.684720 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:35:59.685158 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.685833 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.687234 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.687642 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.687746 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.688815 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:35:59.688820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:35:59.688823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:35:59.688842 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:35:59.688875 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:35:59.688886 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:35:59.688959 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.689191 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.689268 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 01:35:59.693899 11441 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:35:59.701108 11441 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:35:59.715397 11651 heartbeater.cc:503] Master 127.23.39.254:33611 was elected leader, sending a full tablet report...
I20260811 01:35:59.725971 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.714509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:45359 (local address 127.0.0.1:51000)
0811 01:35:59.716210 (+ 1701us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.716250 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.716439 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.718107 (+ 1668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.718114 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.718175 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:59.718705 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.718720 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.720673 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.720678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.723080 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.723094 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.724882 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.724888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.725109 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.725171 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.725317 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.725513 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1447,"mutex_wait_us":107,"thread_start_us":2031,"threads_started":1}
I20260811 01:35:59.726830 11967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.714821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48004 (local address 127.23.39.194:32811)
0811 01:35:59.715418 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.715428 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.716987 (+ 1559us) server_negotiation.cc:407] Connection header received
0811 01:35:59.717331 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.717341 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.717551 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.717762 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:59.719277 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.720850 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.723816 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.725253 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.725407 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.725627 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.726262 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.726449 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":340,"threads_started":1}
I20260811 01:35:59.727267 11970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.716931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42432)
0811 01:35:59.719225 (+ 2294us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.719244 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.719369 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.719944 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.719949 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.719975 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:59.720358 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.720370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.722339 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.722345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.724288 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.724299 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.726479 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.726487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.726635 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.726657 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.726768 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.726917 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2151,"mutex_wait_us":33,"thread_start_us":1996,"threads_started":1}
I20260811 01:35:59.727298 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.715117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51000 (local address 127.23.39.195:45359)
0811 01:35:59.716299 (+ 1182us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.716311 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.716358 (+ 47us) server_negotiation.cc:407] Connection header received
0811 01:35:59.716743 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.716752 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.716996 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.717804 (+ 808us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:59.718996 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.720530 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.723298 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.724678 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.724827 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.725136 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.725413 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.726908 (+ 1495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":982,"thread_start_us":823,"threads_started":1}
I20260811 01:35:59.727635 11966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.714521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:32811 (local address 127.0.0.1:48004)
0811 01:35:59.716877 (+ 2356us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.716895 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.717114 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.718113 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.718120 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.718191 (+ 71us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:59.719078 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.719096 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.721001 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.721006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.723590 (+ 2584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.723605 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.725773 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.725782 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.725999 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.726035 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.727097 (+ 1062us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.727253 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2201,"mutex_wait_us":913,"thread_start_us":605,"threads_started":1}
I20260811 01:35:59.728392 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.717517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.23.39.193:44813)
0811 01:35:59.718692 (+ 1175us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.718703 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.719358 (+ 655us) server_negotiation.cc:407] Connection header received
0811 01:35:59.719509 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.719518 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.719748 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.719936 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:59.720541 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.722150 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.724470 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.725864 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.726019 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.727824 (+ 1805us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.727906 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.728086 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":834,"threads_started":1}
I20260811 01:35:59.731307 11726 tablet_service.cc:1467] Processing CreateTablet for tablet 746815295a9044e48aed0a1587d74e33 (DEFAULT_TABLE table=test-table [id=e4562786af7a4a3ebce007e31325dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:59.731307 11875 tablet_service.cc:1467] Processing CreateTablet for tablet 746815295a9044e48aed0a1587d74e33 (DEFAULT_TABLE table=test-table [id=e4562786af7a4a3ebce007e31325dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:59.731719 11576 tablet_service.cc:1467] Processing CreateTablet for tablet 746815295a9044e48aed0a1587d74e33 (DEFAULT_TABLE table=test-table [id=e4562786af7a4a3ebce007e31325dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:35:59.732862 11875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746815295a9044e48aed0a1587d74e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:59.732877 11726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746815295a9044e48aed0a1587d74e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:59.733022 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 746815295a9044e48aed0a1587d74e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:35:59.746896 11972 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Bootstrap starting.
I20260811 01:35:59.750607 11972 tablet_bootstrap.cc:654] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:59.751003 11974 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Bootstrap starting.
I20260811 01:35:59.752244 11972 log.cc:824] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:59.754356 11973 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Bootstrap starting.
I20260811 01:35:59.755782 11972 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: No bootstrap required, opened a new log
I20260811 01:35:59.755929 11974 tablet_bootstrap.cc:654] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:59.756114 11972 ts_tablet_manager.cc:1397] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:35:59.757297 11974 log.cc:824] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:59.758203 11973 tablet_bootstrap.cc:654] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Neither blocks nor log segments found. Creating new log.
I20260811 01:35:59.759441 11973 log.cc:824] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Log is configured to *not* fsync() on all Append() calls
I20260811 01:35:59.760670 11974 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: No bootstrap required, opened a new log
I20260811 01:35:59.760990 11974 ts_tablet_manager.cc:1397] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 01:35:59.762727 11973 tablet_bootstrap.cc:492] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: No bootstrap required, opened a new log
I20260811 01:35:59.763000 11973 ts_tablet_manager.cc:1397] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:35:59.764467 11972 raft_consensus.cc:348] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.764943 11972 raft_consensus.cc:374] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:59.765054 11972 raft_consensus.cc:729] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfd07b09953a4f1ea919320e2f2e5bb8, State: Initialized, Role: FOLLOWER
I20260811 01:35:59.765691 11972 consensus_queue.cc:260] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.767127 11951 heartbeater.cc:503] Master 127.23.39.254:33611 was elected leader, sending a full tablet report...
I20260811 01:35:59.767661 11972 ts_tablet_manager.cc:1428] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Time spent starting tablet: real 0.011s user 0.006s sys 0.006s
I20260811 01:35:59.772253 11973 raft_consensus.cc:348] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.772795 11973 raft_consensus.cc:374] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:59.772921 11973 raft_consensus.cc:729] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c8435f761364152bb345e94822938ef, State: Initialized, Role: FOLLOWER
I20260811 01:35:59.772471 11974 raft_consensus.cc:348] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.773152 11974 raft_consensus.cc:374] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:35:59.773298 11974 raft_consensus.cc:729] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91c53403bf640dca7b939fae925fb85, State: Initialized, Role: FOLLOWER
I20260811 01:35:59.773698 11973 consensus_queue.cc:260] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.773877 11974 consensus_queue.cc:260] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.775030 11800 heartbeater.cc:503] Master 127.23.39.254:33611 was elected leader, sending a full tablet report...
I20260811 01:35:59.775808 11973 ts_tablet_manager.cc:1428] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260811 01:35:59.776080 11974 ts_tablet_manager.cc:1428] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Time spent starting tablet: real 0.015s user 0.004s sys 0.011s
W20260811 01:35:59.910015 11952 tablet.cc:2369] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:35:59.934942 11801 tablet.cc:2369] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:35:59.943306 11652 tablet.cc:2369] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:35:59.949162 11978 raft_consensus.cc:482] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:35:59.949519 11978 raft_consensus.cc:504] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.951429 11978 leader_election.cc:288] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c8435f761364152bb345e94822938ef (127.23.39.194:32811), b91c53403bf640dca7b939fae925fb85 (127.23.39.193:44813)
I20260811 01:35:59.957584 11953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.951833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:32811 (local address 127.23.39.195:45405)
0811 01:35:59.952062 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.952092 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.952239 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.952746 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.952750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.952782 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:59.952995 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.953009 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.954405 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.954411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.955745 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.955757 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.956822 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.956831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.957001 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.957025 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.957129 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.957277 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:35:59.957578 11967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.951842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:45405 (local address 127.23.39.194:32811)
0811 01:35:59.952212 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.952218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.952240 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:35:59.952418 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.952422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.952491 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.952590 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:59.953170 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.954269 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.955909 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.956661 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.956842 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.956915 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.957156 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.957285 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234}
I20260811 01:35:59.958703 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.952074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46751 (local address 127.23.39.193:44813)
0811 01:35:59.952290 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:35:59.952298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:35:59.953137 (+ 839us) server_negotiation.cc:407] Connection header received
0811 01:35:59.953441 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:35:59.953445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:35:59.953555 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:35:59.953654 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:35:59.954264 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.955000 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.956740 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.957514 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.957702 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.957793 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:35:59.958321 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 01:35:59.958456 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:35:59.958742 11981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:35:59.952086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.23.39.195:46751)
0811 01:35:59.953012 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0811 01:35:59.953039 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:35:59.953250 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:35:59.953691 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:35:59.953696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:35:59.953722 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:35:59.954074 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.954085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.955165 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.955171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.956548 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:35:59.956561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:35:59.957987 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:35:59.957994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:35:59.958151 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:35:59.958174 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 01:35:59.958284 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 01:35:59.958428 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":465,"threads_started":1}
I20260811 01:35:59.958591 11750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746815295a9044e48aed0a1587d74e33" candidate_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8435f761364152bb345e94822938ef" is_pre_election: true
I20260811 01:35:59.959275 11750 raft_consensus.cc:2454] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfd07b09953a4f1ea919320e2f2e5bb8 in term 0.
I20260811 01:35:59.959862 11600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746815295a9044e48aed0a1587d74e33" candidate_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b91c53403bf640dca7b939fae925fb85" is_pre_election: true
I20260811 01:35:59.960029 11822 leader_election.cc:302] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c8435f761364152bb345e94822938ef, cfd07b09953a4f1ea919320e2f2e5bb8; no voters:
I20260811 01:35:59.960405 11600 raft_consensus.cc:2454] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfd07b09953a4f1ea919320e2f2e5bb8 in term 0.
I20260811 01:35:59.960490 11978 raft_consensus.cc:2781] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:35:59.960637 11978 raft_consensus.cc:482] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:35:59.960764 11978 raft_consensus.cc:3037] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:59.963153 11978 raft_consensus.cc:504] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.963721 11978 leader_election.cc:288] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 4c8435f761364152bb345e94822938ef (127.23.39.194:32811), b91c53403bf640dca7b939fae925fb85 (127.23.39.193:44813)
I20260811 01:35:59.964283 11600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746815295a9044e48aed0a1587d74e33" candidate_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b91c53403bf640dca7b939fae925fb85"
I20260811 01:35:59.964284 11750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "746815295a9044e48aed0a1587d74e33" candidate_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8435f761364152bb345e94822938ef"
I20260811 01:35:59.964509 11600 raft_consensus.cc:3037] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:59.964522 11750 raft_consensus.cc:3037] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:35:59.967878 11750 raft_consensus.cc:2454] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfd07b09953a4f1ea919320e2f2e5bb8 in term 1.
I20260811 01:35:59.967878 11600 raft_consensus.cc:2454] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfd07b09953a4f1ea919320e2f2e5bb8 in term 1.
I20260811 01:35:59.968415 11823 leader_election.cc:302] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4c8435f761364152bb345e94822938ef, b91c53403bf640dca7b939fae925fb85, cfd07b09953a4f1ea919320e2f2e5bb8; no voters:
I20260811 01:35:59.968750 11978 raft_consensus.cc:2781] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:35:59.969254 11978 raft_consensus.cc:686] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 1 LEADER]: Becoming Leader. State: Replica: cfd07b09953a4f1ea919320e2f2e5bb8, State: Running, Role: LEADER
I20260811 01:35:59.969753 11978 consensus_queue.cc:237] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } }
I20260811 01:35:59.975028 11440 catalog_manager.cc:5495] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfd07b09953a4f1ea919320e2f2e5bb8 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfd07b09953a4f1ea919320e2f2e5bb8" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 45359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260811 01:36:00.024735 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.018719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51004 (local address 127.23.39.195:45359)
0811 01:36:00.018932 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:00.018938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:00.019060 (+ 122us) server_negotiation.cc:407] Connection header received
0811 01:36:00.019357 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:00.019362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:00.019447 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:00.019621 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:00.020060 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.020818 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.022392 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.022842 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.022986 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:00.023572 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:00.024108 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:00.024297 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:00.024360 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 01:36:00.024445 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:36:00.033612 11750 raft_consensus.cc:1261] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 1 FOLLOWER]: Refusing update from remote peer cfd07b09953a4f1ea919320e2f2e5bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:00.033655 11600 raft_consensus.cc:1261] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 1 FOLLOWER]: Refusing update from remote peer cfd07b09953a4f1ea919320e2f2e5bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:00.034696 11985 consensus_queue.cc:1035] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c8435f761364152bb345e94822938ef" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:00.035079 11978 consensus_queue.cc:1035] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91c53403bf640dca7b939fae925fb85" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:00.066768 11441 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:00.067121 11441 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:00.071326 11441 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4a323528d2bb45edaf2b8f92b97edd07: Sending DeleteTablet for 3 replicas of tablet 746815295a9044e48aed0a1587d74e33
I20260811 01:36:00.072772 11726 tablet_service.cc:1514] Processing DeleteTablet for tablet 746815295a9044e48aed0a1587d74e33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:00 UTC) from {username='slave'} at 127.0.0.1:48004
I20260811 01:36:00.072860 11576 tablet_service.cc:1514] Processing DeleteTablet for tablet 746815295a9044e48aed0a1587d74e33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:00 UTC) from {username='slave'} at 127.0.0.1:42432
I20260811 01:36:00.072980 11875 tablet_service.cc:1514] Processing DeleteTablet for tablet 746815295a9044e48aed0a1587d74e33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:00 UTC) from {username='slave'} at 127.0.0.1:51000
I20260811 01:36:00.074797 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11509
I20260811 01:36:00.085436 12000 tablet_replica.cc:330] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: stopping tablet replica
I20260811 01:36:00.086270 12001 tablet_replica.cc:330] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: stopping tablet replica
I20260811 01:36:00.087112 12001 raft_consensus.cc:2229] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:36:00.087780 12000 raft_consensus.cc:2229] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:00.088517 12000 raft_consensus.cc:2258] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:00.089511 12001 raft_consensus.cc:2258] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:00.092653 11971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.076193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42444 (local address 127.23.39.193:44813)
0811 01:36:00.076382 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:00.076388 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:00.082678 (+ 6290us) server_negotiation.cc:407] Connection header received
0811 01:36:00.083032 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:00.083041 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:00.083219 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:00.083317 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:00.084327 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.085891 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.087926 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.088694 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.088800 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:00.090819 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:00.090833 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:00.090850 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:00.091659 (+ 809us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:00.091724 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:00.091750 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:00.091843 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:00.092103 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 01:36:00.092231 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:36:00.093775 11998 tablet_replica.cc:330] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: stopping tablet replica
I20260811 01:36:00.093861 12000 ts_tablet_manager.cc:1905] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:00.095813 12001 ts_tablet_manager.cc:1905] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:00.096372 11998 raft_consensus.cc:2229] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:00.096967 11998 raft_consensus.cc:2258] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:00.101267 12000 ts_tablet_manager.cc:1918] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:00.101492 12000 log.cc:1196] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/746815295a9044e48aed0a1587d74e33
I20260811 01:36:00.102157 12000 ts_tablet_manager.cc:1939] T 746815295a9044e48aed0a1587d74e33 P 4c8435f761364152bb345e94822938ef: Deleting consensus metadata
I20260811 01:36:00.103448 11646 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:00.104190 11422 catalog_manager.cc:4841] TS 4c8435f761364152bb345e94822938ef (127.23.39.194:32811): tablet 746815295a9044e48aed0a1587d74e33 (table test-table [id=e4562786af7a4a3ebce007e31325dcbb]) successfully deleted
I20260811 01:36:00.107353 12001 ts_tablet_manager.cc:1918] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:00.107564 12001 log.cc:1196] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/746815295a9044e48aed0a1587d74e33
I20260811 01:36:00.108116 12001 ts_tablet_manager.cc:1939] T 746815295a9044e48aed0a1587d74e33 P cfd07b09953a4f1ea919320e2f2e5bb8: Deleting consensus metadata
I20260811 01:36:00.109882 11423 catalog_manager.cc:4841] TS cfd07b09953a4f1ea919320e2f2e5bb8 (127.23.39.195:45359): tablet 746815295a9044e48aed0a1587d74e33 (table test-table [id=e4562786af7a4a3ebce007e31325dcbb]) successfully deleted
I20260811 01:36:00.103885 11998 ts_tablet_manager.cc:1905] T 746815295a9044e48aed0a1587d74e33 P b91c53403bf640dca7b939fae925fb85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:00.214915 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11509
W20260811 01:36:00.238492 11423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:44813 (error 108)
I20260811 01:36:00.238675 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11655
I20260811 01:36:00.241698 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.240226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42448)
0811 01:36:00.241293 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.241454 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":772,"threads_started":1}
W20260811 01:36:00.241932 11423 catalog_manager.cc:4584] TS b91c53403bf640dca7b939fae925fb85 (127.23.39.193:44813): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 746815295a9044e48aed0a1587d74e33: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
I20260811 01:36:00.246730 11967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.239646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48008 (local address 127.23.39.194:32811)
0811 01:36:00.239831 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:00.239839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:00.239866 (+ 27us) server_negotiation.cc:407] Connection header received
0811 01:36:00.240136 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:00.240143 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:00.240254 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:00.240395 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:00.240919 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.241861 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.243411 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.243848 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.243991 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:00.245170 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:00.245184 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:00.245199 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:00.245810 (+ 611us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:00.245858 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:00.245877 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:00.246015 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:00.246218 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 01:36:00.246334 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:36:00.247596 11794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:00.295933 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.295342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42450)
0811 01:36:00.295608 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.295747 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:36:00.297195 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.296744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42456)
0811 01:36:00.296925 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.297017 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 01:36:00.339463 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11655
I20260811 01:36:00.358361 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.357679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42468)
0811 01:36:00.357973 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.358095 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 01:36:00.359721 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.359192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42472)
0811 01:36:00.359399 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.359504 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 01:36:00.361876 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11804
I20260811 01:36:00.370210 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.362727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51014 (local address 127.23.39.195:45359)
0811 01:36:00.362885 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:00.362890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:00.362966 (+ 76us) server_negotiation.cc:407] Connection header received
0811 01:36:00.363226 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:00.363230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:00.363311 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:00.363401 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:00.363920 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.364714 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.366785 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:00.367277 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:00.367373 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:00.368671 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:00.368681 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:00.368696 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:00.369330 (+ 634us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:00.369379 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:00.369399 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:00.369490 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:00.369676 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 01:36:00.369759 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 01:36:00.371037 11946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:00.440299 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.439792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42478)
0811 01:36:00.440022 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.440113 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 01:36:00.441421 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.440969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42486)
0811 01:36:00.441194 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.441265 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260811 01:36:00.501775 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11804
I20260811 01:36:00.525697 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 11405
I20260811 01:36:00.526958 11475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:00.639456 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:00.638617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:44813 (local address 127.0.0.1:42500)
0811 01:36:00.639076 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:00.639235 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:44813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300}
I20260811 01:36:00.639442 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 11405
2026-08-11T01:36:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3116 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:00 dist-test-slave-9jjr krb5kdc[12013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:00 dist-test-slave-9jjr krb5kdc[12013](info): set up 2 sockets
Aug 11 01:36:00 dist-test-slave-9jjr krb5kdc[12013](info): commencing operation
krb5kdc: starting...
W20260811 01:36:01.880182 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:02 dist-test-slave-9jjr krb5kdc[12013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:02.226306 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34331
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:34331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:02.577817 12029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:02.578336 12029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:02.578507 12029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:02.586346 12029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:02.586468 12029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:02.586560 12029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:02.586666 12029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:02.586745 12029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:02.597024 12029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:34331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:02.598489 12029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:02.599786 12029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:02.611999 12035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:02.612072 12037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:02.612031 12034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:02.612913 12029 server_base.cc:1034] running on GCE node
I20260811 01:36:02.613746 12029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:02.615322 12029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:02.616533 12029 hybrid_clock.cc:648] HybridClock initialized: now 1786412162616488 us; error 44 us; skew 500 ppm
I20260811 01:36:02.616900 12029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:02 dist-test-slave-9jjr krb5kdc[12013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:02.623610 12029 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:02.625313 12029 webserver.cc:460] Webserver started at http://127.23.39.254:41341/ using document root <none> and password file <none>
I20260811 01:36:02.626029 12029 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:02.626224 12029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:02.626570 12029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:02.629719 12029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "1b1589f1a999450285f1d93b04c936f0"
format_stamp: "Formatted at 2026-08-11 01:36:02 on dist-test-slave-9jjr"
server_key: "367eed3c49f2157cc0a9e7c3164f8646"
server_key_iv: "bd9530119f2a4165c21db95ae7f82009"
server_key_version: "encryptionkey@0"
I20260811 01:36:02.630589 12029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "1b1589f1a999450285f1d93b04c936f0"
format_stamp: "Formatted at 2026-08-11 01:36:02 on dist-test-slave-9jjr"
server_key: "367eed3c49f2157cc0a9e7c3164f8646"
server_key_iv: "bd9530119f2a4165c21db95ae7f82009"
server_key_version: "encryptionkey@0"
I20260811 01:36:02.636083 12029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 01:36:02.639927 12044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:02.641402 12029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 01:36:02.641623 12029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "1b1589f1a999450285f1d93b04c936f0"
format_stamp: "Formatted at 2026-08-11 01:36:02 on dist-test-slave-9jjr"
server_key: "367eed3c49f2157cc0a9e7c3164f8646"
server_key_iv: "bd9530119f2a4165c21db95ae7f82009"
server_key_version: "encryptionkey@0"
I20260811 01:36:02.641870 12029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:02.661660 12029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:02.667726 12029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:02.668061 12029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:02.688396 12029 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:34331
I20260811 01:36:02.688433 12100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:34331 every 8 connection(s)
I20260811 01:36:02.689891 12029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:02.690261 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12029
I20260811 01:36:02.690462 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:02.691032 23711 external_mini_cluster.cc:1428] Setting key 1c54c71663d83f56ea83cde93c65ac6c
I20260811 01:36:02.694906 12101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 01:36:02 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:02.706442 12101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: Bootstrap starting.
I20260811 01:36:02.709805 12101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:02.711071 12101 log.cc:824] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:02.714231 12101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: No bootstrap required, opened a new log
I20260811 01:36:02.715744 12105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:02.693106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50924 (local address 127.23.39.254:34331)
0811 01:36:02.693978 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:02.693990 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:02.694034 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:36:02.696185 (+ 2151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:02.696210 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:02.696615 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:02.697024 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:02.698681 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:02.700078 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:02.701939 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:02.702725 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:02.702940 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:02.707613 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:02.707622 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:02.707642 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:02.707686 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:02.711129 (+ 3443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:02.712068 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:02.712083 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:02.712091 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:02.712300 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:02.712792 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:02.712800 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:02.712808 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:02.713346 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:02.713675 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:02.714185 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 01:36:02.714699 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":421,"threads_started":1}
I20260811 01:36:02.723099 12101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } }
I20260811 01:36:02.723580 12101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:02.723728 12101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1589f1a999450285f1d93b04c936f0, State: Initialized, Role: FOLLOWER
I20260811 01:36:02.724466 12101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } }
I20260811 01:36:02.724813 12101 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:02.724979 12101 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:02.725178 12101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:02.727667 12101 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } }
I20260811 01:36:02.728228 12101 leader_election.cc:302] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b1589f1a999450285f1d93b04c936f0; no voters:
I20260811 01:36:02.728874 12101 leader_election.cc:288] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:02.729153 12108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:02.729990 12108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b1589f1a999450285f1d93b04c936f0, State: Running, Role: LEADER
I20260811 01:36:02.730682 12108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } }
I20260811 01:36:02.731441 12101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:02.734041 12110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1589f1a999450285f1d93b04c936f0. Latest consensus state: current_term: 1 leader_uuid: "1b1589f1a999450285f1d93b04c936f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } } }
I20260811 01:36:02.734536 12110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:02.734385 12109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b1589f1a999450285f1d93b04c936f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b1589f1a999450285f1d93b04c936f0" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34331 } } }
I20260811 01:36:02.734647 12109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:02.739431 12118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:02.744647 12118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:02.753973 12118 catalog_manager.cc:1347] Generated new cluster ID: 60980124757e44eba2de194b9ae09859
I20260811 01:36:02.754108 12118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:02.774381 12118 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:02.776315 12118 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:02.783203 12118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: Generated new TSK 0
I20260811 01:36:02.784309 12118 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:36:02.875139 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:03.242727 12132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:03.243024 12132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:03.243239 12132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:03.250975 12132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:03.251111 12132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:03.251228 12132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:36:03.261236 12132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:03.262666 12132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:03.264101 12132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:03.277791 12139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:03.277773 12138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:03.278020 12141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:03.278920 12132 server_base.cc:1034] running on GCE node
I20260811 01:36:03.279620 12132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:03.280652 12132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:03.281924 12132 hybrid_clock.cc:648] HybridClock initialized: now 1786412163281863 us; error 46 us; skew 500 ppm
I20260811 01:36:03.282354 12132 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:03 dist-test-slave-9jjr krb5kdc[12013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412163, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:03.285804 12132 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:36:03.287472 12132 webserver.cc:460] Webserver started at http://127.23.39.193:46543/ using document root <none> and password file <none>
I20260811 01:36:03.288213 12132 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:03.288373 12132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:03.288707 12132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:03.291941 12132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "e230ea3afcb7416eaf88eaa185b6bbd9"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "c10a221b1d83f131ba77019f909addc6"
server_key_iv: "bfddb3deab8f15fe427ed6e65599cbab"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.292840 12132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "e230ea3afcb7416eaf88eaa185b6bbd9"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "c10a221b1d83f131ba77019f909addc6"
server_key_iv: "bfddb3deab8f15fe427ed6e65599cbab"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.298624 12132 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:36:03.302443 12149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.303969 12132 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:03.304180 12132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "e230ea3afcb7416eaf88eaa185b6bbd9"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "c10a221b1d83f131ba77019f909addc6"
server_key_iv: "bfddb3deab8f15fe427ed6e65599cbab"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.304412 12132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:03.318744 12132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:03.323781 12132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:03.324119 12132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:03.325194 12132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:03.326808 12132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:03.326916 12132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.327076 12132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:03.327155 12132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.366163 12132 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:41055
I20260811 01:36:03.366266 12276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:41055 every 8 connection(s)
I20260811 01:36:03.367537 12132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:36:03.376058 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12132
I20260811 01:36:03.376294 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:36:03.376807 23711 external_mini_cluster.cc:1428] Setting key eb20083137a9db1b905d2bb5bab0f7ec
Aug 11 01:36:03 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412163, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:03.389953 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:03.370219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:39339 (local address 127.23.39.254:34331)
0811 01:36:03.370733 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:03.370738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:03.371515 (+ 777us) server_negotiation.cc:407] Connection header received
0811 01:36:03.373407 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:03.373412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:03.373523 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:03.373649 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:03.375278 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.376011 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.377918 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.378729 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.378911 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:03.383289 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:03.383294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:03.383297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:03.383334 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:03.386054 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:03.387228 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:03.387284 (+ 56us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:03.387288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:03.387502 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:03.388016 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:03.388021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:03.388024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:03.388321 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:03.388480 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:03.389296 (+ 816us) server_negotiation.cc:299] Negotiation successful
0811 01:36:03.389552 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":384,"thread_start_us":270,"threads_started":1}
I20260811 01:36:03.391099 12280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:03.370611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34331 (local address 127.23.39.193:39339)
0811 01:36:03.371341 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:03.371382 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:03.373119 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:03.373895 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:03.373903 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:03.374522 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:03.375096 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:03.375112 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.376177 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.376188 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:03.377702 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:03.377717 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.378980 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.378985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:03.379294 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:03.380082 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:03.380118 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:03.382963 (+ 2845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:03.386288 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:03.386299 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:03.386319 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:03.387023 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:03.387646 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:03.387653 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:03.387657 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:03.387886 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:03.388466 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:03.388474 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:03.388878 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 01:36:03.389178 (+ 300us) client_negotiation.cc:240] Negotiation successful
0811 01:36:03.389761 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":278,"threads_started":1}
I20260811 01:36:03.392766 12277 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34331
I20260811 01:36:03.393115 12277 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:03.394155 12277 heartbeater.cc:511] Master 127.23.39.254:34331 requested a full tablet report, sending...
I20260811 01:36:03.396597 12062 ts_manager.cc:194] Registered new tserver with Master: e230ea3afcb7416eaf88eaa185b6bbd9 (127.23.39.193:41055)
I20260811 01:36:03.398193 12062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:39339
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:36:03.454547 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:03.821936 12283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:03.822353 12283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:03.822573 12283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:03.830358 12283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:03.830490 12283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:03.830691 12283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:36:03.841271 12283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:03.842730 12283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:03.844251 12283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:03.858407 12290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:03.858534 12289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:03.858608 12292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:03.859726 12283 server_base.cc:1034] running on GCE node
I20260811 01:36:03.860484 12283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:03.861596 12283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:03.862831 12283 hybrid_clock.cc:648] HybridClock initialized: now 1786412163862774 us; error 38 us; skew 500 ppm
I20260811 01:36:03.863224 12283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:03 dist-test-slave-9jjr krb5kdc[12013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412163, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:03.866890 12283 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:36:03.868801 12283 webserver.cc:460] Webserver started at http://127.23.39.194:32967/ using document root <none> and password file <none>
I20260811 01:36:03.869652 12283 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:03.869798 12283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:03.870194 12283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:03.873512 12283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "622223511f87dc13c1e5bff5bb4bb36d"
server_key_iv: "f23e364342810f28b20a366eefd68891"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.874503 12283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "622223511f87dc13c1e5bff5bb4bb36d"
server_key_iv: "f23e364342810f28b20a366eefd68891"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.880190 12283 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:03.883879 12300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.885210 12283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 01:36:03.885399 12283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261"
format_stamp: "Formatted at 2026-08-11 01:36:03 on dist-test-slave-9jjr"
server_key: "622223511f87dc13c1e5bff5bb4bb36d"
server_key_iv: "f23e364342810f28b20a366eefd68891"
server_key_version: "encryptionkey@0"
I20260811 01:36:03.885624 12283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:03.903942 12283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:03.908334 12283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:03.908659 12283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:03.909866 12283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:03.911378 12283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:03.911605 12283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.911792 12283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:03.911873 12283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:03.947968 12283 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:34991
I20260811 01:36:03.948071 12422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:34991 every 8 connection(s)
I20260811 01:36:03.949414 12283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:36:03.950621 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12283
I20260811 01:36:03.950829 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:36:03.951462 23711 external_mini_cluster.cc:1428] Setting key 4808097b35adf639ebcf95df91619947
Aug 11 01:36:03 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412163, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:03.972280 12426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:03.952473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:49235 (local address 127.23.39.254:34331)
0811 01:36:03.953000 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:03.953004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:03.954291 (+ 1287us) server_negotiation.cc:407] Connection header received
0811 01:36:03.956232 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:03.956240 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:03.956344 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:03.956482 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:03.958060 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.959290 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.960948 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.961695 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.961841 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:03.965755 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:03.965764 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:03.965771 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:03.965820 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:03.968989 (+ 3169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:03.969753 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:03.969761 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:03.969766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:03.969902 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:03.970425 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:03.970431 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:03.970434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:03.970723 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:03.970882 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:03.971644 (+ 762us) server_negotiation.cc:299] Negotiation successful
0811 01:36:03.971898 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":317,"threads_started":1}
I20260811 01:36:03.973268 12427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:03.953139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34331 (local address 127.23.39.194:49235)
0811 01:36:03.954082 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:03.954169 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:03.955935 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:03.956715 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:03.956724 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:03.957267 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:03.957861 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:03.957879 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.959491 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.959495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:03.960788 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:03.960800 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:03.961997 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:03.962003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:03.962370 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:03.963141 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:03.963169 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:03.965447 (+ 2278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:03.969147 (+ 3700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:03.969166 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:03.969185 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:03.969623 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:03.970020 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:03.970025 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:03.970029 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:03.970308 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:03.970856 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:03.970864 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:03.971229 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 01:36:03.971553 (+ 324us) client_negotiation.cc:240] Negotiation successful
0811 01:36:03.972090 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":436,"threads_started":1}
I20260811 01:36:03.974875 12424 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34331
I20260811 01:36:03.975186 12424 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:03.975934 12424 heartbeater.cc:511] Master 127.23.39.254:34331 requested a full tablet report, sending...
I20260811 01:36:03.977530 12062 ts_manager.cc:194] Registered new tserver with Master: 57d9d8c5309c4a3e8c5cf51bc4e38261 (127.23.39.194:34991)
I20260811 01:36:03.978910 12062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:49235
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:36:04.026377 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:04.389729 12430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:04.390110 12430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:04.390313 12430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:04.397568 12430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:04.397730 12430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:04.397982 12430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:36:04.401470 12277 heartbeater.cc:503] Master 127.23.39.254:34331 was elected leader, sending a full tablet report...
I20260811 01:36:04.408591 12430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:34331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:04.409996 12430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:04.411303 12430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:04.425403 12438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:04.425434 12436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:04.425647 12435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:04.426309 12430 server_base.cc:1034] running on GCE node
I20260811 01:36:04.426963 12430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:04.428047 12430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:04.429330 12430 hybrid_clock.cc:648] HybridClock initialized: now 1786412164429264 us; error 47 us; skew 500 ppm
I20260811 01:36:04.429751 12430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:04 dist-test-slave-9jjr krb5kdc[12013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412164, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:04.433425 12430 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:36:04.435153 12430 webserver.cc:460] Webserver started at http://127.23.39.195:39005/ using document root <none> and password file <none>
I20260811 01:36:04.435992 12430 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:04.436108 12430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:04.436441 12430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:04.439646 12430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "b369692cc5d54c4083a8da95b55262d6"
format_stamp: "Formatted at 2026-08-11 01:36:04 on dist-test-slave-9jjr"
server_key: "ef04665adb27affcc159c01ee844b67f"
server_key_iv: "8f9c887eff51632fd05f179e3ee8226a"
server_key_version: "encryptionkey@0"
I20260811 01:36:04.440441 12430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "b369692cc5d54c4083a8da95b55262d6"
format_stamp: "Formatted at 2026-08-11 01:36:04 on dist-test-slave-9jjr"
server_key: "ef04665adb27affcc159c01ee844b67f"
server_key_iv: "8f9c887eff51632fd05f179e3ee8226a"
server_key_version: "encryptionkey@0"
I20260811 01:36:04.446516 12430 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:36:04.450299 12447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:04.451771 12430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:04.451967 12430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "b369692cc5d54c4083a8da95b55262d6"
format_stamp: "Formatted at 2026-08-11 01:36:04 on dist-test-slave-9jjr"
server_key: "ef04665adb27affcc159c01ee844b67f"
server_key_iv: "8f9c887eff51632fd05f179e3ee8226a"
server_key_version: "encryptionkey@0"
I20260811 01:36:04.452231 12430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:04.467971 12430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:04.472247 12430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:04.472553 12430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:04.473542 12430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:04.475075 12430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:04.475152 12430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:04.475303 12430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:04.475370 12430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:04.510627 12430 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:34209
I20260811 01:36:04.510679 12572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:34209 every 8 connection(s)
I20260811 01:36:04.511953 12430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:36:04.512442 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12430
I20260811 01:36:04.512687 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:36:04.513434 23711 external_mini_cluster.cc:1428] Setting key c52e4c70f10d85d6eb73ea34c26e9c55
Aug 11 01:36:04 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412164, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:04.533995 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.514886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:49833 (local address 127.23.39.254:34331)
0811 01:36:04.515431 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.515437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.516568 (+ 1131us) server_negotiation.cc:407] Connection header received
0811 01:36:04.518468 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.518472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.518539 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.518632 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:04.520161 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.520951 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.522554 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.522954 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.523051 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.527215 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:04.527221 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:04.527225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:04.527272 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:04.530716 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.531525 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.531531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.531535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.531665 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.532142 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.532146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.532148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.532428 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:04.532608 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.533356 (+ 748us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.533588 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":241,"threads_started":1}
I20260811 01:36:04.535058 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.515520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:34331 (local address 127.23.39.195:49833)
0811 01:36:04.516399 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.516450 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.518219 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.518834 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.518842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.519391 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:04.519991 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.520009 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.521095 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.521099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.522429 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.522441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.523192 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.523198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.523392 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.524019 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:04.524040 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:04.526607 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:04.530871 (+ 4264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:04.530880 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:04.530899 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:04.531367 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:04.531789 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:04.531795 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:04.531799 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:04.532010 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:04.532589 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:04.532598 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:04.532967 (+ 369us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.533245 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.533807 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":357,"threads_started":1}
I20260811 01:36:04.536706 12573 heartbeater.cc:347] Connected to a master server at 127.23.39.254:34331
I20260811 01:36:04.537052 12573 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:04.537863 12573 heartbeater.cc:511] Master 127.23.39.254:34331 requested a full tablet report, sending...
I20260811 01:36:04.539471 12062 ts_manager.cc:194] Registered new tserver with Master: b369692cc5d54c4083a8da95b55262d6 (127.23.39.195:34209)
I20260811 01:36:04.540302 12062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:49833
I20260811 01:36:04.542263 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:36:04.560628 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.546904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50926 (local address 127.23.39.254:34331)
0811 01:36:04.547294 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.547301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.547601 (+ 300us) server_negotiation.cc:407] Connection header received
0811 01:36:04.547748 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.547751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.547831 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.547916 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:04.549325 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.550078 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.551432 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.551813 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.551908 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.554743 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:04.554748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:04.554751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:04.554785 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:04.557621 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.558498 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.558508 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.558510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.558631 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.559101 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.559111 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.559113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.559421 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:04.559711 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.560136 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.560330 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 01:36:04.564807 12061 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:36:04.571755 12061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:36:04.598484 12590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.584411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34991 (local address 127.0.0.1:39016)
0811 01:36:04.585808 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.585881 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.586073 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.587257 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.587268 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.587310 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:04.587922 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.587939 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.590823 (+ 2884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.590832 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.594033 (+ 3201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.594055 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.596980 (+ 2925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.596989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.597318 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.597393 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.597557 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.597825 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"spinlock_wait_cycles":5248,"thread_start_us":799,"threads_started":1}
I20260811 01:36:04.600358 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.584596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39016 (local address 127.23.39.194:34991)
0811 01:36:04.585165 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.585178 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.586297 (+ 1119us) server_negotiation.cc:407] Connection header received
0811 01:36:04.586406 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.586413 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.586682 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.586911 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:04.588205 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.590629 (+ 2424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.594329 (+ 3700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.596349 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.596527 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.596787 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.599830 (+ 3043us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.600025 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":275,"threads_started":1}
I20260811 01:36:04.604535 12353 tablet_service.cc:1467] Processing CreateTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 (DEFAULT_TABLE table=test-table [id=d209753c3e394eb48593cb0b24eda38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:04.605974 12353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c27760394ac4d38af6b5f29b87f1024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:04.607638 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.584550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34209 (local address 127.0.0.1:46736)
0811 01:36:04.585808 (+ 1258us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.585881 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.586073 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.600165 (+ 14092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.600171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.600197 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:04.600870 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.600884 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.602701 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.602708 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.604798 (+ 2090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.604810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.606675 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.606682 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.606857 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.606890 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.607001 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.607150 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1090,"spinlock_wait_cycles":9984,"thread_start_us":1062,"threads_started":1}
I20260811 01:36:04.607693 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.585334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46736 (local address 127.23.39.195:34209)
0811 01:36:04.599475 (+ 14141us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.599484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.599517 (+ 33us) server_negotiation.cc:407] Connection header received
0811 01:36:04.599628 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.599636 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.599923 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.601091 (+ 1168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:04.601401 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.602557 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.604961 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.606442 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.606579 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.606800 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.607076 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.607264 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13961,"thread_start_us":13762,"threads_started":1}
I20260811 01:36:04.609746 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.586800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.23.39.193:41055)
0811 01:36:04.602405 (+ 15605us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.602415 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.602446 (+ 31us) server_negotiation.cc:407] Connection header received
0811 01:36:04.602545 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.602553 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.602796 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.603008 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:04.603515 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.605012 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.607226 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.608631 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.608785 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.609008 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.609258 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.609422 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14624,"thread_start_us":14458,"threads_started":1}
I20260811 01:36:04.610677 12590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.586052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:41055 (local address 127.0.0.1:35510)
0811 01:36:04.599531 (+ 13479us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.599553 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.599665 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.603007 (+ 3342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.603013 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.603040 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:04.603298 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.603310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.605164 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.605170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.607033 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.607051 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.608795 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.608801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.609052 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.609093 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.609219 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.609377 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13382,"thread_start_us":14816,"threads_started":1}
I20260811 01:36:04.612041 12502 tablet_service.cc:1467] Processing CreateTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 (DEFAULT_TABLE table=test-table [id=d209753c3e394eb48593cb0b24eda38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:04.613204 12502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c27760394ac4d38af6b5f29b87f1024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:04.614060 12203 tablet_service.cc:1467] Processing CreateTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 (DEFAULT_TABLE table=test-table [id=d209753c3e394eb48593cb0b24eda38a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:04.615494 12203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c27760394ac4d38af6b5f29b87f1024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:04.622915 12596 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Bootstrap starting.
I20260811 01:36:04.625592 12597 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Bootstrap starting.
I20260811 01:36:04.627136 12596 tablet_bootstrap.cc:654] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:04.628337 12596 log.cc:824] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:04.629241 12597 tablet_bootstrap.cc:654] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:04.630568 12597 log.cc:824] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:04.631093 12599 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Bootstrap starting.
I20260811 01:36:04.631793 12596 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: No bootstrap required, opened a new log
I20260811 01:36:04.632118 12596 ts_tablet_manager.cc:1397] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 01:36:04.635007 12599 tablet_bootstrap.cc:654] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:04.636374 12599 log.cc:824] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:04.637005 12597 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: No bootstrap required, opened a new log
I20260811 01:36:04.637324 12597 ts_tablet_manager.cc:1397] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260811 01:36:04.640719 12599 tablet_bootstrap.cc:492] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: No bootstrap required, opened a new log
I20260811 01:36:04.641016 12599 ts_tablet_manager.cc:1397] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.004s
I20260811 01:36:04.643019 12596 raft_consensus.cc:348] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.643591 12596 raft_consensus.cc:374] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:04.643718 12596 raft_consensus.cc:729] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d9d8c5309c4a3e8c5cf51bc4e38261, State: Initialized, Role: FOLLOWER
I20260811 01:36:04.644369 12596 consensus_queue.cc:260] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.645947 12597 raft_consensus.cc:348] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.646420 12597 raft_consensus.cc:374] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:04.646543 12597 raft_consensus.cc:729] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b369692cc5d54c4083a8da95b55262d6, State: Initialized, Role: FOLLOWER
I20260811 01:36:04.647266 12424 heartbeater.cc:503] Master 127.23.39.254:34331 was elected leader, sending a full tablet report...
I20260811 01:36:04.647253 12597 consensus_queue.cc:260] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.647884 12596 ts_tablet_manager.cc:1428] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260811 01:36:04.648500 12573 heartbeater.cc:503] Master 127.23.39.254:34331 was elected leader, sending a full tablet report...
I20260811 01:36:04.649013 12597 ts_tablet_manager.cc:1428] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260811 01:36:04.653780 12599 raft_consensus.cc:348] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.654395 12599 raft_consensus.cc:374] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:04.654517 12599 raft_consensus.cc:729] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e230ea3afcb7416eaf88eaa185b6bbd9, State: Initialized, Role: FOLLOWER
I20260811 01:36:04.655184 12599 consensus_queue.cc:260] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.656984 12599 ts_tablet_manager.cc:1428] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260811 01:36:04.692854 12606 raft_consensus.cc:482] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:36:04.693205 12606 raft_consensus.cc:504] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.695389 12606 leader_election.cc:288] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57d9d8c5309c4a3e8c5cf51bc4e38261 (127.23.39.194:34991), b369692cc5d54c4083a8da95b55262d6 (127.23.39.195:34209)
W20260811 01:36:04.701697 12425 tablet.cc:2369] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:04.704912 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.696734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:42111 (local address 127.23.39.195:34209)
0811 01:36:04.696996 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.697005 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.698088 (+ 1083us) server_negotiation.cc:407] Connection header received
0811 01:36:04.698291 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.698297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.698376 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.698472 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:04.699480 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.700663 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.703038 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.703840 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.704045 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.704129 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.704503 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.704646 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:36:04.705166 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.696076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:47485 (local address 127.23.39.194:34991)
0811 01:36:04.696372 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.696382 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.697848 (+ 1466us) server_negotiation.cc:407] Connection header received
0811 01:36:04.698234 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.698240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.698335 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.698392 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:04.699578 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.700298 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.702913 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.704176 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.704366 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.704442 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.704760 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.704891 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 01:36:04.705281 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.695571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34991 (local address 127.23.39.193:47485)
0811 01:36:04.697691 (+ 2120us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.697719 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.697993 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.698637 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.698641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.698757 (+ 116us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:04.699454 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.699465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.700443 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.700448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.702728 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.702749 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.704415 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.704424 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.704583 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.704616 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.704714 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.704846 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1911,"mutex_wait_us":4,"spinlock_wait_cycles":29952,"thread_start_us":1671,"threads_started":1}
I20260811 01:36:04.705685 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.695817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34209 (local address 127.23.39.193:42111)
0811 01:36:04.697967 (+ 2150us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:04.697984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:04.698119 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:04.698522 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:04.698529 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:04.698564 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:04.699247 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.699273 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.700803 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.700808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.702882 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:04.702895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.704069 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.704075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:04.704270 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.704308 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 01:36:04.705209 (+ 901us) client_negotiation.cc:240] Negotiation successful
0811 01:36:04.705361 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2023,"thread_start_us":1826,"threads_started":1}
I20260811 01:36:04.706454 12374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c27760394ac4d38af6b5f29b87f1024" candidate_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" is_pre_election: true
I20260811 01:36:04.706758 12522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c27760394ac4d38af6b5f29b87f1024" candidate_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b369692cc5d54c4083a8da95b55262d6" is_pre_election: true
I20260811 01:36:04.707105 12374 raft_consensus.cc:2454] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e230ea3afcb7416eaf88eaa185b6bbd9 in term 0.
I20260811 01:36:04.707311 12522 raft_consensus.cc:2454] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e230ea3afcb7416eaf88eaa185b6bbd9 in term 0.
I20260811 01:36:04.707914 12154 leader_election.cc:302] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57d9d8c5309c4a3e8c5cf51bc4e38261, e230ea3afcb7416eaf88eaa185b6bbd9; no voters:
I20260811 01:36:04.708348 12606 raft_consensus.cc:2781] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:36:04.708521 12606 raft_consensus.cc:482] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:36:04.708630 12606 raft_consensus.cc:3037] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:04.710968 12606 raft_consensus.cc:504] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.711619 12606 leader_election.cc:288] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [CANDIDATE]: Term 1 election: Requested vote from peers 57d9d8c5309c4a3e8c5cf51bc4e38261 (127.23.39.194:34991), b369692cc5d54c4083a8da95b55262d6 (127.23.39.195:34209)
I20260811 01:36:04.712154 12522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c27760394ac4d38af6b5f29b87f1024" candidate_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b369692cc5d54c4083a8da95b55262d6"
I20260811 01:36:04.712148 12374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c27760394ac4d38af6b5f29b87f1024" candidate_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261"
I20260811 01:36:04.712502 12374 raft_consensus.cc:3037] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:04.712502 12522 raft_consensus.cc:3037] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:04.715912 12522 raft_consensus.cc:2454] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e230ea3afcb7416eaf88eaa185b6bbd9 in term 1.
I20260811 01:36:04.715912 12374 raft_consensus.cc:2454] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e230ea3afcb7416eaf88eaa185b6bbd9 in term 1.
I20260811 01:36:04.716373 12154 leader_election.cc:302] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57d9d8c5309c4a3e8c5cf51bc4e38261, e230ea3afcb7416eaf88eaa185b6bbd9; no voters:
I20260811 01:36:04.716841 12606 raft_consensus.cc:2781] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:04.717392 12606 raft_consensus.cc:686] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 1 LEADER]: Becoming Leader. State: Replica: e230ea3afcb7416eaf88eaa185b6bbd9, State: Running, Role: LEADER
I20260811 01:36:04.717886 12606 consensus_queue.cc:237] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } }
I20260811 01:36:04.722538 12062 catalog_manager.cc:5495] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e230ea3afcb7416eaf88eaa185b6bbd9 (127.23.39.193). New cstate: current_term: 1 leader_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e230ea3afcb7416eaf88eaa185b6bbd9" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 41055 } health_report { overall_health: HEALTHY } } }
I20260811 01:36:04.756415 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.750810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.23.39.193:41055)
0811 01:36:04.750996 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.751000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.751019 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:36:04.751167 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.751171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.751271 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.751404 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:04.751810 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.752578 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.753946 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.754451 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.754561 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.755156 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:04.755807 (+ 651us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:04.755981 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.756167 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.756211 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 01:36:04.764629 12574 tablet.cc:2369] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:04.765174 12522 raft_consensus.cc:1261] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 1 FOLLOWER]: Refusing update from remote peer e230ea3afcb7416eaf88eaa185b6bbd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:04.765259 12374 raft_consensus.cc:1261] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 1 FOLLOWER]: Refusing update from remote peer e230ea3afcb7416eaf88eaa185b6bbd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:04.766326 12609 consensus_queue.cc:1035] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b369692cc5d54c4083a8da95b55262d6" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:04.766741 12606 consensus_queue.cc:1035] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57d9d8c5309c4a3e8c5cf51bc4e38261" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:04.797127 12060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:04.797451 12060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:04.801743 12060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b1589f1a999450285f1d93b04c936f0: Sending DeleteTablet for 3 replicas of tablet 9c27760394ac4d38af6b5f29b87f1024
I20260811 01:36:04.803148 12353 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:04 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:39016
I20260811 01:36:04.803661 12502 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:04 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:46736
I20260811 01:36:04.804417 12203 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c27760394ac4d38af6b5f29b87f1024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:04 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:35510
I20260811 01:36:04.804839 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12132
I20260811 01:36:04.815793 12624 tablet_replica.cc:330] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: stopping tablet replica
I20260811 01:36:04.816604 12624 raft_consensus.cc:2229] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:04.817363 12624 raft_consensus.cc:2258] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:04.820200 12624 ts_tablet_manager.cc:1905] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:04.821982 12626 tablet_replica.cc:330] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: stopping tablet replica
I20260811 01:36:04.822502 12626 raft_consensus.cc:2229] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:36:04.823342 12626 raft_consensus.cc:2258] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:04.824013 12625 tablet_replica.cc:330] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: stopping tablet replica
I20260811 01:36:04.824461 12625 raft_consensus.cc:2229] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:04.825179 12625 raft_consensus.cc:2258] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:04.827919 12625 ts_tablet_manager.cc:1905] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:04.828382 12624 ts_tablet_manager.cc:1918] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:04.828636 12624 log.cc:1196] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/9c27760394ac4d38af6b5f29b87f1024
I20260811 01:36:04.829100 12626 ts_tablet_manager.cc:1905] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:04.829499 12624 ts_tablet_manager.cc:1939] T 9c27760394ac4d38af6b5f29b87f1024 P 57d9d8c5309c4a3e8c5cf51bc4e38261: Deleting consensus metadata
I20260811 01:36:04.831568 12048 catalog_manager.cc:4841] TS 57d9d8c5309c4a3e8c5cf51bc4e38261 (127.23.39.194:34991): tablet 9c27760394ac4d38af6b5f29b87f1024 (table test-table [id=d209753c3e394eb48593cb0b24eda38a]) successfully deleted
I20260811 01:36:04.835403 12625 ts_tablet_manager.cc:1918] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:04.835602 12625 log.cc:1196] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/9c27760394ac4d38af6b5f29b87f1024
I20260811 01:36:04.836189 12625 ts_tablet_manager.cc:1939] T 9c27760394ac4d38af6b5f29b87f1024 P b369692cc5d54c4083a8da95b55262d6: Deleting consensus metadata
Aug 11 01:36:04 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:36:04.838346 12045 catalog_manager.cc:4841] TS b369692cc5d54c4083a8da95b55262d6 (127.23.39.195:34209): tablet 9c27760394ac4d38af6b5f29b87f1024 (table test-table [id=d209753c3e394eb48593cb0b24eda38a]) successfully deleted
I20260811 01:36:04.839192 12626 ts_tablet_manager.cc:1918] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:04.839426 12626 log.cc:1196] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/9c27760394ac4d38af6b5f29b87f1024
I20260811 01:36:04.840090 12626 ts_tablet_manager.cc:1939] T 9c27760394ac4d38af6b5f29b87f1024 P e230ea3afcb7416eaf88eaa185b6bbd9: Deleting consensus metadata
I20260811 01:36:04.842224 12045 catalog_manager.cc:4841] TS e230ea3afcb7416eaf88eaa185b6bbd9 (127.23.39.193:41055): tablet 9c27760394ac4d38af6b5f29b87f1024 (table test-table [id=d209753c3e394eb48593cb0b24eda38a]) successfully deleted
I20260811 01:36:04.847728 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.806490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35530 (local address 127.23.39.193:41055)
0811 01:36:04.806743 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.806752 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.818762 (+ 12010us) server_negotiation.cc:407] Connection header received
0811 01:36:04.819345 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.819353 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.819455 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.819548 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:04.823773 (+ 4225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.824938 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.831314 (+ 6376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.832069 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.832172 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.839836 (+ 7664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:04.839855 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:04.839873 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:04.839924 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:04.843997 (+ 4073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.845076 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.845084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.845086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.845369 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.845850 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.845854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.845856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.846447 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:04.846693 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.847143 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.847386 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 01:36:04.848488 12271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:04.953290 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12132
I20260811 01:36:04.975728 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12283
Aug 11 01:36:04 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:36:04.991349 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:04.976567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39022 (local address 127.23.39.194:34991)
0811 01:36:04.976797 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:04.976804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:04.976825 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:36:04.977053 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:04.977057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:04.977124 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:04.977251 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:04.978713 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.979474 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.980731 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:04.981143 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:04.981276 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:04.985689 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:04.985704 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:04.985720 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:04.985754 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:04.988670 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.989384 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.989391 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.989393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.989511 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:04.989920 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:04.989927 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:04.989934 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:04.990387 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:04.990617 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:04.990894 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 01:36:04.991063 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:36:04.992033 12418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:05.083850 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12283
I20260811 01:36:05.105448 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12430
Aug 11 01:36:05 dist-test-slave-9jjr krb5kdc[12013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:36:05.121668 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:05.106496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46752 (local address 127.23.39.195:34209)
0811 01:36:05.106670 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:05.106681 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:05.106699 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:36:05.106849 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:05.106853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:05.106918 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:05.107006 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:05.108609 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:05.109346 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:05.110989 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:05.111380 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:05.111475 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:05.116157 (+ 4682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:05.116176 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:05.116198 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:05.116243 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:05.119161 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:05.119834 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:05.119841 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:05.119843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:05.119995 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:05.120351 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:05.120354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:05.120356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:05.120711 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:05.120927 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:05.121233 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 01:36:05.121419 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:36:05.122385 12567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:05.215867 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12430
I20260811 01:36:05.237614 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12029
I20260811 01:36:05.238893 12096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:05.353107 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12029
2026-08-11T01:36:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4709 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T01:36:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:05Z Disabled control of system clock
I20260811 01:36:05.455644 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39061
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:41345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:36:05.811250 12636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:05.811558 12636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:05.811641 12636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:05.819079 12636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:05.819204 12636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:05.819244 12636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:05.819296 12636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:05.819341 12636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:05.829162 12636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39061
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:05.830562 12636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:05.832448 12636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:05.845162 12641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:05.845175 12642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:05.845112 12644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:05.846016 12636 server_base.cc:1034] running on GCE node
I20260811 01:36:05.846978 12636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:05.848642 12636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:05.849877 12636 hybrid_clock.cc:648] HybridClock initialized: now 1786412165849800 us; error 61 us; skew 500 ppm
I20260811 01:36:05.850370 12636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:05.852923 12636 webserver.cc:460] Webserver started at http://127.23.39.254:37149/ using document root <none> and password file <none>
I20260811 01:36:05.853662 12636 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:05.853760 12636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:05.854055 12636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:05.857242 12636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "db42ac623efa4eed97b5ebf149ffc1ec"
format_stamp: "Formatted at 2026-08-11 01:36:05 on dist-test-slave-9jjr"
server_key: "409420723145be6603fde6b7e8a9b019"
server_key_iv: "cd8a0d1199b7a72a5ce081964c8198c5"
server_key_version: "encryptionkey@0"
I20260811 01:36:05.858261 12636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "db42ac623efa4eed97b5ebf149ffc1ec"
format_stamp: "Formatted at 2026-08-11 01:36:05 on dist-test-slave-9jjr"
server_key: "409420723145be6603fde6b7e8a9b019"
server_key_iv: "cd8a0d1199b7a72a5ce081964c8198c5"
server_key_version: "encryptionkey@0"
I20260811 01:36:05.863713 12636 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260811 01:36:05.867462 12650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:05.869042 12636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:36:05.869225 12636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "db42ac623efa4eed97b5ebf149ffc1ec"
format_stamp: "Formatted at 2026-08-11 01:36:05 on dist-test-slave-9jjr"
server_key: "409420723145be6603fde6b7e8a9b019"
server_key_iv: "cd8a0d1199b7a72a5ce081964c8198c5"
server_key_version: "encryptionkey@0"
I20260811 01:36:05.869427 12636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:05.887269 12636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:05.888176 12636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:05.888427 12636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:05.908383 12636 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39061
I20260811 01:36:05.908425 12707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39061 every 8 connection(s)
I20260811 01:36:05.909907 12636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:05.914076 12708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:05.918972 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12636
I20260811 01:36:05.919163 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:05.919749 23711 external_mini_cluster.cc:1428] Setting key 6abe0a581b6f944c29d7cc9dc2839a33
I20260811 01:36:05.926844 12708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: Bootstrap starting.
I20260811 01:36:05.930258 12708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:05.931377 12708 log.cc:824] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:05.935170 12708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: No bootstrap required, opened a new log
I20260811 01:36:05.935624 12711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:05.921940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.23.39.254:39061)
0811 01:36:05.923058 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:05.923637 (+ 579us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:05.923690 (+ 53us) server_negotiation.cc:407] Connection header received
0811 01:36:05.925555 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:05.925582 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:05.926050 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:05.926569 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:05.927196 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:05.928662 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:05.930110 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:05.930931 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:05.931163 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:05.932621 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:05.932628 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:05.932645 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:05.933417 (+ 772us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:05.933526 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:05.933554 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:05.933681 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:05.933921 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 01:36:05.934322 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":443,"threads_started":1}
I20260811 01:36:05.943506 12708 raft_consensus.cc:348] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } }
I20260811 01:36:05.943903 12708 raft_consensus.cc:374] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:05.943984 12708 raft_consensus.cc:729] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db42ac623efa4eed97b5ebf149ffc1ec, State: Initialized, Role: FOLLOWER
I20260811 01:36:05.944658 12708 consensus_queue.cc:260] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } }
I20260811 01:36:05.944934 12708 raft_consensus.cc:388] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:05.945119 12708 raft_consensus.cc:482] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:05.945313 12708 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:05.947639 12708 raft_consensus.cc:504] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } }
I20260811 01:36:05.948177 12708 leader_election.cc:302] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db42ac623efa4eed97b5ebf149ffc1ec; no voters:
I20260811 01:36:05.948822 12708 leader_election.cc:288] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:05.949223 12713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:05.950311 12713 raft_consensus.cc:686] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [term 1 LEADER]: Becoming Leader. State: Replica: db42ac623efa4eed97b5ebf149ffc1ec, State: Running, Role: LEADER
I20260811 01:36:05.950822 12713 consensus_queue.cc:237] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } }
I20260811 01:36:05.951236 12708 sys_catalog.cc:564] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:05.953768 12715 sys_catalog.cc:455] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader db42ac623efa4eed97b5ebf149ffc1ec. Latest consensus state: current_term: 1 leader_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } } }
I20260811 01:36:05.954349 12715 sys_catalog.cc:458] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:05.953926 12714 sys_catalog.cc:455] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db42ac623efa4eed97b5ebf149ffc1ec" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39061 } } }
I20260811 01:36:05.954782 12714 sys_catalog.cc:458] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:05.955961 12722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:05.962201 12722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:05.971714 12722 catalog_manager.cc:1347] Generated new cluster ID: e2fd88c42a7e4beb8c4723c813f611da
I20260811 01:36:05.971895 12722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:05.991986 12722 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:05.993335 12722 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:06.001314 12722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: Generated new TSK 0
I20260811 01:36:06.002230 12722 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:06.013506 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--builtin_ntp_servers=127.23.39.212:41345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:36:06.366103 12732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:06.366523 12732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:06.366740 12732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:06.374511 12732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:06.374625 12732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:06.374791 12732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:36:06.384939 12732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:06.386411 12732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:06.388298 12732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:06.401895 12738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:06.401948 12741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:06.401894 12739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:06.403168 12732 server_base.cc:1034] running on GCE node
I20260811 01:36:06.403864 12732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:06.404794 12732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:06.406018 12732 hybrid_clock.cc:648] HybridClock initialized: now 1786412166405971 us; error 32 us; skew 500 ppm
I20260811 01:36:06.406430 12732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:06.408838 12732 webserver.cc:460] Webserver started at http://127.23.39.193:35273/ using document root <none> and password file <none>
I20260811 01:36:06.409664 12732 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:06.409768 12732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:06.410032 12732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:06.413301 12732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "daf108d890f84f37b15c941e65c49648"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "1c37b3b7a9ad7701a46049ba304b8429"
server_key_iv: "990b64e594fcd2b9bd7d5d3aecba3f3f"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.414089 12732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "daf108d890f84f37b15c941e65c49648"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "1c37b3b7a9ad7701a46049ba304b8429"
server_key_iv: "990b64e594fcd2b9bd7d5d3aecba3f3f"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.419744 12732 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 01:36:06.423729 12748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.425287 12732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:06.425491 12732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "daf108d890f84f37b15c941e65c49648"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "1c37b3b7a9ad7701a46049ba304b8429"
server_key_iv: "990b64e594fcd2b9bd7d5d3aecba3f3f"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.425729 12732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:06.442270 12732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:06.443204 12732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:06.443523 12732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:06.444582 12732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:06.446179 12732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:06.446314 12732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.446452 12732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:06.446564 12732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.481451 12732 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:35319
I20260811 01:36:06.481542 12875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:35319 every 8 connection(s)
I20260811 01:36:06.482851 12732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:36:06.489058 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12732
I20260811 01:36:06.489274 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:36:06.489841 23711 external_mini_cluster.cc:1428] Setting key 361d999d83875d2b8e4a63901a61ae03
I20260811 01:36:06.493233 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--builtin_ntp_servers=127.23.39.212:41345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:36:06.497951 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:06.485629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:55551 (local address 127.23.39.254:39061)
0811 01:36:06.486097 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:06.486104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:06.487403 (+ 1299us) server_negotiation.cc:407] Connection header received
0811 01:36:06.489622 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:06.489626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:06.489698 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:06.489791 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:06.491227 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.492282 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.494870 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.495294 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.495400 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:06.497145 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:06.497150 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:06.497154 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:06.497174 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:06.497226 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:06.497237 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:06.497311 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:06.497597 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:36:06.497685 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":231,"threads_started":1}
I20260811 01:36:06.499495 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:06.486300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39061 (local address 127.23.39.193:55551)
0811 01:36:06.487227 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:06.487264 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:06.489276 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:06.490083 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:06.490094 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:06.490248 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:06.491040 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:06.491061 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.492454 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.492460 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:06.494685 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:06.494706 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.495542 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.495551 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:06.495883 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:06.496713 (+ 830us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:06.496719 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:06.496778 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:06.496886 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:06.497341 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:06.497355 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:06.497366 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 01:36:06.497550 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 01:36:06.497991 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":299,"threads_started":1}
I20260811 01:36:06.501462 12876 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39061
I20260811 01:36:06.501796 12876 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:06.502656 12876 heartbeater.cc:511] Master 127.23.39.254:39061 requested a full tablet report, sending...
I20260811 01:36:06.505025 12669 ts_manager.cc:194] Registered new tserver with Master: daf108d890f84f37b15c941e65c49648 (127.23.39.193:35319)
I20260811 01:36:06.507258 12669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.193:55551
W20260811 01:36:06.863626 12880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:06.864019 12880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:06.864197 12880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:06.871731 12880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:06.871908 12880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:06.872092 12880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:36:06.881771 12880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:06.883272 12880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:06.885154 12880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:06.899638 12885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:06.899601 12886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:06.899758 12889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:06.900676 12880 server_base.cc:1034] running on GCE node
I20260811 01:36:06.901352 12880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:06.902453 12880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:06.903723 12880 hybrid_clock.cc:648] HybridClock initialized: now 1786412166903675 us; error 59 us; skew 500 ppm
I20260811 01:36:06.904075 12880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:06.906653 12880 webserver.cc:460] Webserver started at http://127.23.39.194:44259/ using document root <none> and password file <none>
I20260811 01:36:06.907433 12880 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:06.907572 12880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:06.907992 12880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:06.912552 12880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "4ca6e929da8446fbb9d323af331c082c"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "f77b3c8c6ea66c57999188126aa29c5f"
server_key_iv: "25fb553addc17a80de61f87ecdbda0de"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.913625 12880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "4ca6e929da8446fbb9d323af331c082c"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "f77b3c8c6ea66c57999188126aa29c5f"
server_key_iv: "25fb553addc17a80de61f87ecdbda0de"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.920576 12880 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260811 01:36:06.925496 12895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.927243 12880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:06.927443 12880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "4ca6e929da8446fbb9d323af331c082c"
format_stamp: "Formatted at 2026-08-11 01:36:06 on dist-test-slave-9jjr"
server_key: "f77b3c8c6ea66c57999188126aa29c5f"
server_key_iv: "25fb553addc17a80de61f87ecdbda0de"
server_key_version: "encryptionkey@0"
I20260811 01:36:06.927681 12880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:06.944840 12880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:06.945775 12880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:06.946209 12880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:06.947311 12880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:06.948957 12880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:06.949100 12880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.949236 12880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:06.949328 12880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:06.985594 12880 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:33373
I20260811 01:36:06.985651 13020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:33373 every 8 connection(s)
I20260811 01:36:06.987022 12880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:36:06.989678 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 12880
I20260811 01:36:06.989863 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:36:06.990501 23711 external_mini_cluster.cc:1428] Setting key dd5116a6448c467db3bba2384088b675
I20260811 01:36:06.993446 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--builtin_ntp_servers=127.23.39.212:41345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:36:07.002562 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:06.990233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:36635 (local address 127.23.39.254:39061)
0811 01:36:06.990465 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:06.990472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:06.992219 (+ 1747us) server_negotiation.cc:407] Connection header received
0811 01:36:06.994477 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:06.994485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:06.994579 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:06.994711 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:06.995897 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.997056 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.998902 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.999595 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.999758 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.001438 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:07.001447 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:07.001455 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:07.001483 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:07.001527 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:07.001546 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:07.001645 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.001995 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.002115 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 01:36:07.003542 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:06.990837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39061 (local address 127.23.39.194:36635)
0811 01:36:06.992048 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:06.992111 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:06.994119 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:06.994929 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:06.994937 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:06.995034 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:06.995705 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:06.995724 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.997222 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.997226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:06.998750 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:06.998763 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:06.999858 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:06.999868 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.000255 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.001055 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:07.001058 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:07.001139 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:07.001233 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:07.001704 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:07.001719 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:07.001731 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.001963 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.002364 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":421,"threads_started":1}
I20260811 01:36:07.005079 13021 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39061
I20260811 01:36:07.005425 13021 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:07.006399 13021 heartbeater.cc:511] Master 127.23.39.254:39061 requested a full tablet report, sending...
I20260811 01:36:07.008090 12669 ts_manager.cc:194] Registered new tserver with Master: 4ca6e929da8446fbb9d323af331c082c (127.23.39.194:33373)
I20260811 01:36:07.008973 12669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.194:36635
W20260811 01:36:07.353713 13024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:07.354180 13024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:07.354362 13024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:07.362039 13024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:07.362247 13024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:07.362432 13024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:36:07.372009 13024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:41345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:07.373513 13024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:07.375567 13024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:07.388950 13030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:07.388929 13031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:07.388979 13033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:07.390022 13024 server_base.cc:1034] running on GCE node
I20260811 01:36:07.390813 13024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:07.391794 13024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:07.393007 13024 hybrid_clock.cc:648] HybridClock initialized: now 1786412167392927 us; error 75 us; skew 500 ppm
I20260811 01:36:07.393363 13024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:07.395885 13024 webserver.cc:460] Webserver started at http://127.23.39.195:46471/ using document root <none> and password file <none>
I20260811 01:36:07.396659 13024 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:07.396801 13024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:07.397135 13024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:07.400767 13024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "1a63e63341084ad5b406e415cc8e037b"
format_stamp: "Formatted at 2026-08-11 01:36:07 on dist-test-slave-9jjr"
server_key: "98cfb4cffe28ad8436327991b97d0bef"
server_key_iv: "935e1ef8bd61a814af60cb52017d09a3"
server_key_version: "encryptionkey@0"
I20260811 01:36:07.401724 13024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "1a63e63341084ad5b406e415cc8e037b"
format_stamp: "Formatted at 2026-08-11 01:36:07 on dist-test-slave-9jjr"
server_key: "98cfb4cffe28ad8436327991b97d0bef"
server_key_iv: "935e1ef8bd61a814af60cb52017d09a3"
server_key_version: "encryptionkey@0"
I20260811 01:36:07.407472 13024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:36:07.411334 13039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:07.412736 13024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:36:07.412927 13024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "1a63e63341084ad5b406e415cc8e037b"
format_stamp: "Formatted at 2026-08-11 01:36:07 on dist-test-slave-9jjr"
server_key: "98cfb4cffe28ad8436327991b97d0bef"
server_key_iv: "935e1ef8bd61a814af60cb52017d09a3"
server_key_version: "encryptionkey@0"
I20260811 01:36:07.413167 13024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:07.444974 13024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:07.446044 13024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:07.446475 13024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:07.447605 13024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:07.449201 13024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:07.449292 13024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:07.449455 13024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:07.449541 13024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:07.487035 13024 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:44237
I20260811 01:36:07.487094 13167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:44237 every 8 connection(s)
I20260811 01:36:07.488358 13024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:36:07.491758 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13024
I20260811 01:36:07.491935 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:36:07.492419 23711 external_mini_cluster.cc:1428] Setting key b2e59ee5d40287ae1c1853bb935721c5
I20260811 01:36:07.501959 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.491331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:50521 (local address 127.23.39.254:39061)
0811 01:36:07.491585 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.491592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.493263 (+ 1671us) server_negotiation.cc:407] Connection header received
0811 01:36:07.495286 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.495292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.495386 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.495503 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:07.496656 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.497441 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.499167 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.499592 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.499749 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.501195 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:07.501200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:07.501204 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:07.501224 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:07.501258 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:07.501270 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:07.501379 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.501622 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.501711 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 01:36:07.503110 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.491933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39061 (local address 127.23.39.195:50521)
0811 01:36:07.493085 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.493133 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.494993 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.495785 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.495795 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.495884 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:07.496475 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.496493 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.497645 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.497650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.499008 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.499022 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.499849 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.499858 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.500137 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.500853 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:07.500855 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:07.500897 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:07.500978 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:07.501411 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:07.501420 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:07.501427 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.501596 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.501924 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":386,"threads_started":1}
I20260811 01:36:07.504899 13169 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39061
I20260811 01:36:07.505244 13169 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:07.506351 13169 heartbeater.cc:511] Master 127.23.39.254:39061 requested a full tablet report, sending...
I20260811 01:36:07.508066 12669 ts_manager.cc:194] Registered new tserver with Master: 1a63e63341084ad5b406e415cc8e037b (127.23.39.195:44237)
I20260811 01:36:07.508919 12669 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.195:50521
I20260811 01:36:07.510412 12876 heartbeater.cc:503] Master 127.23.39.254:39061 was elected leader, sending a full tablet report...
I20260811 01:36:07.521217 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:36:07.532351 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.525610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.23.39.254:39061)
0811 01:36:07.525901 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.525908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.526259 (+ 351us) server_negotiation.cc:407] Connection header received
0811 01:36:07.526401 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.526405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.526471 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.526557 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:07.527111 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.527904 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.529350 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.529826 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.529922 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.531394 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:07.531402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:07.531407 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:07.531433 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:07.531495 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:07.531513 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:07.531722 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.531936 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.532000 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:36:07.536898 12669 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:36:07.545168 12669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:36:07.571993 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.559056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:44237 (local address 127.0.0.1:58570)
0811 01:36:07.561870 (+ 2814us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.561889 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.562009 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.563643 (+ 1634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.563651 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.563685 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:07.564327 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.564347 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.566868 (+ 2521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.566876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.569207 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.569220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.571242 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.571248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.571418 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.571449 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.571531 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.571649 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2686,"mutex_wait_us":3,"thread_start_us":2512,"threads_started":1}
I20260811 01:36:07.572273 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.558645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48448 (local address 127.23.39.194:33373)
0811 01:36:07.561510 (+ 2865us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.561521 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.561558 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:36:07.561680 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.561691 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.563295 (+ 1604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.563483 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:07.565007 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.566408 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.568732 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.570364 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.570507 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.571611 (+ 1104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.571693 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.571876 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2690,"thread_start_us":2559,"threads_started":1}
I20260811 01:36:07.572640 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.559174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58570 (local address 127.23.39.195:44237)
0811 01:36:07.562656 (+ 3482us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.562664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.562700 (+ 36us) server_negotiation.cc:407] Connection header received
0811 01:36:07.562809 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.562819 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.563088 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.563303 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:07.565040 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.566687 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.569425 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.570654 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.570801 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.571104 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.571916 (+ 812us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.572126 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3306,"thread_start_us":3119,"threads_started":1}
I20260811 01:36:07.572729 13183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.558554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:33373 (local address 127.0.0.1:48448)
0811 01:36:07.560566 (+ 2012us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.560649 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.560874 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.563745 (+ 2871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.563751 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.563780 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:07.564815 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.564830 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.566589 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.566594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.568519 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.568533 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.570805 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.570812 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.571107 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.571190 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.571325 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.571540 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1647,"mutex_wait_us":592,"thread_start_us":1467,"threads_started":1}
I20260811 01:36:07.574095 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.561949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40886)
0811 01:36:07.564525 (+ 2576us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.564544 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.564672 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.565877 (+ 1205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.565882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.565908 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:07.566355 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.566367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.568845 (+ 2478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.568852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.570937 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.570951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.573291 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.573298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.573464 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.573501 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.573596 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.573792 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2430,"thread_start_us":2271,"threads_started":1}
I20260811 01:36:07.574316 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.562237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40886 (local address 127.23.39.193:35319)
0811 01:36:07.565239 (+ 3002us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.565247 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.565277 (+ 30us) server_negotiation.cc:407] Connection header received
0811 01:36:07.565384 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.565390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.565657 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.566563 (+ 906us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:07.566828 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.568630 (+ 1802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.571188 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.573074 (+ 1886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.573196 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.573452 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.573737 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.573936 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2809,"thread_start_us":2669,"threads_started":1}
I20260811 01:36:07.576710 13091 tablet_service.cc:1467] Processing CreateTablet for tablet 56a4050a542747fba0aac5361a999129 (DEFAULT_TABLE table=test-table [id=42ee9ac3f3004f96adc1c4de8f2640d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:07.577104 12948 tablet_service.cc:1467] Processing CreateTablet for tablet 56a4050a542747fba0aac5361a999129 (DEFAULT_TABLE table=test-table [id=42ee9ac3f3004f96adc1c4de8f2640d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:07.578109 13091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a4050a542747fba0aac5361a999129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:07.577859 12801 tablet_service.cc:1467] Processing CreateTablet for tablet 56a4050a542747fba0aac5361a999129 (DEFAULT_TABLE table=test-table [id=42ee9ac3f3004f96adc1c4de8f2640d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:07.578547 12948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a4050a542747fba0aac5361a999129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:07.579237 12801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a4050a542747fba0aac5361a999129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:07.590505 13188 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Bootstrap starting.
I20260811 01:36:07.594833 13188 tablet_bootstrap.cc:654] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:07.595903 13188 log.cc:824] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:07.596971 13189 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Bootstrap starting.
I20260811 01:36:07.598526 13190 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Bootstrap starting.
I20260811 01:36:07.602270 13189 tablet_bootstrap.cc:654] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:07.602715 13190 tablet_bootstrap.cc:654] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:07.603556 13189 log.cc:824] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:07.603955 13190 log.cc:824] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:07.604060 13188 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: No bootstrap required, opened a new log
I20260811 01:36:07.604350 13188 ts_tablet_manager.cc:1397] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260811 01:36:07.608861 13190 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: No bootstrap required, opened a new log
I20260811 01:36:07.608992 13189 tablet_bootstrap.cc:492] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: No bootstrap required, opened a new log
I20260811 01:36:07.609221 13190 ts_tablet_manager.cc:1397] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 01:36:07.609339 13189 ts_tablet_manager.cc:1397] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260811 01:36:07.616364 13188 raft_consensus.cc:348] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.616892 13188 raft_consensus.cc:374] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:07.617059 13188 raft_consensus.cc:729] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a63e63341084ad5b406e415cc8e037b, State: Initialized, Role: FOLLOWER
I20260811 01:36:07.617301 13190 raft_consensus.cc:348] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.617749 13190 raft_consensus.cc:374] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:07.617861 13190 raft_consensus.cc:729] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf108d890f84f37b15c941e65c49648, State: Initialized, Role: FOLLOWER
I20260811 01:36:07.617735 13188 consensus_queue.cc:260] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.618470 13190 consensus_queue.cc:260] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.618956 13169 heartbeater.cc:503] Master 127.23.39.254:39061 was elected leader, sending a full tablet report...
I20260811 01:36:07.619683 13188 ts_tablet_manager.cc:1428] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260811 01:36:07.620216 13189 raft_consensus.cc:348] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.620764 13189 raft_consensus.cc:374] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:07.620883 13189 raft_consensus.cc:729] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca6e929da8446fbb9d323af331c082c, State: Initialized, Role: FOLLOWER
I20260811 01:36:07.621574 13190 ts_tablet_manager.cc:1428] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260811 01:36:07.621474 13189 consensus_queue.cc:260] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.625051 13021 heartbeater.cc:503] Master 127.23.39.254:39061 was elected leader, sending a full tablet report...
I20260811 01:36:07.625783 13189 ts_tablet_manager.cc:1428] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260811 01:36:07.657179 13197 raft_consensus.cc:482] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:36:07.657544 13197 raft_consensus.cc:504] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.659541 13197 leader_election.cc:288] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a63e63341084ad5b406e415cc8e037b (127.23.39.195:44237), daf108d890f84f37b15c941e65c49648 (127.23.39.193:35319)
I20260811 01:36:07.668877 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.660133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:35023 (local address 127.23.39.193:35319)
0811 01:36:07.660376 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.660385 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.661284 (+ 899us) server_negotiation.cc:407] Connection header received
0811 01:36:07.661460 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.661464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.661563 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.661663 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:07.662399 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.663106 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.666331 (+ 3225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.667599 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.667796 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.667871 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.668462 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.668604 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:36:07.668877 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.660002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:49023 (local address 127.23.39.195:44237)
0811 01:36:07.660260 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.660270 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.661117 (+ 847us) server_negotiation.cc:407] Connection header received
0811 01:36:07.661392 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.661401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.661488 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.661568 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:07.662308 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.663093 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.666324 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.667639 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.667796 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.667871 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.668462 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.668614 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:36:07.669064 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.660045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.23.39.194:35023)
0811 01:36:07.661159 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.661175 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.661322 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.661705 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.661710 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.661745 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:07.662217 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.662246 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.663305 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.663310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.666039 (+ 2729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.666055 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.667895 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.667901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.668164 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.668306 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.668409 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.668615 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"mutex_wait_us":353,"thread_start_us":707,"threads_started":1}
I20260811 01:36:07.669138 13199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.659888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:44237 (local address 127.23.39.194:49023)
0811 01:36:07.660966 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.660983 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:07.661187 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:07.661623 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:07.661630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:07.661658 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:07.662090 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.662101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.663234 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.663242 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.666039 (+ 2797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:07.666055 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.667868 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.667880 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:07.668165 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.668306 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 01:36:07.668409 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 01:36:07.668610 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"mutex_wait_us":299,"spinlock_wait_cycles":35072,"thread_start_us":703,"threads_started":1}
I20260811 01:36:07.670514 13115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56a4050a542747fba0aac5361a999129" candidate_uuid: "4ca6e929da8446fbb9d323af331c082c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a63e63341084ad5b406e415cc8e037b" is_pre_election: true
I20260811 01:36:07.670514 12827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56a4050a542747fba0aac5361a999129" candidate_uuid: "4ca6e929da8446fbb9d323af331c082c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf108d890f84f37b15c941e65c49648" is_pre_election: true
I20260811 01:36:07.671197 12827 raft_consensus.cc:2454] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca6e929da8446fbb9d323af331c082c in term 0.
I20260811 01:36:07.671175 13115 raft_consensus.cc:2454] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca6e929da8446fbb9d323af331c082c in term 0.
I20260811 01:36:07.671967 12897 leader_election.cc:302] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca6e929da8446fbb9d323af331c082c, daf108d890f84f37b15c941e65c49648; no voters:
I20260811 01:36:07.672384 13197 raft_consensus.cc:2781] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:36:07.672569 13197 raft_consensus.cc:482] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:36:07.672705 13197 raft_consensus.cc:3037] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:07.675282 13197 raft_consensus.cc:504] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.675928 13197 leader_election.cc:288] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [CANDIDATE]: Term 1 election: Requested vote from peers 1a63e63341084ad5b406e415cc8e037b (127.23.39.195:44237), daf108d890f84f37b15c941e65c49648 (127.23.39.193:35319)
I20260811 01:36:07.676571 13115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56a4050a542747fba0aac5361a999129" candidate_uuid: "4ca6e929da8446fbb9d323af331c082c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a63e63341084ad5b406e415cc8e037b"
I20260811 01:36:07.676571 12827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56a4050a542747fba0aac5361a999129" candidate_uuid: "4ca6e929da8446fbb9d323af331c082c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf108d890f84f37b15c941e65c49648"
I20260811 01:36:07.676818 12827 raft_consensus.cc:3037] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:07.676818 13115 raft_consensus.cc:3037] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:07.680301 12827 raft_consensus.cc:2454] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca6e929da8446fbb9d323af331c082c in term 1.
I20260811 01:36:07.680302 13115 raft_consensus.cc:2454] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca6e929da8446fbb9d323af331c082c in term 1.
I20260811 01:36:07.680895 12899 leader_election.cc:302] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a63e63341084ad5b406e415cc8e037b, 4ca6e929da8446fbb9d323af331c082c; no voters:
I20260811 01:36:07.681350 13197 raft_consensus.cc:2781] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:07.681856 13197 raft_consensus.cc:686] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 1 LEADER]: Becoming Leader. State: Replica: 4ca6e929da8446fbb9d323af331c082c, State: Running, Role: LEADER
I20260811 01:36:07.682471 13197 consensus_queue.cc:237] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } }
I20260811 01:36:07.687513 12666 catalog_manager.cc:5495] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ca6e929da8446fbb9d323af331c082c (127.23.39.194). New cstate: current_term: 1 leader_uuid: "4ca6e929da8446fbb9d323af331c082c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca6e929da8446fbb9d323af331c082c" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 33373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 } health_report { overall_health: UNKNOWN } } }
I20260811 01:36:07.733604 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.727442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48452 (local address 127.23.39.194:33373)
0811 01:36:07.727682 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.727689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.727803 (+ 114us) server_negotiation.cc:407] Connection header received
0811 01:36:07.728076 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.728081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.728249 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.728416 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:07.728836 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.729574 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.731125 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.731576 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.731722 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.732395 (+ 673us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:07.732943 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:07.733149 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.733296 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.733345 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 01:36:07.735471 12877 tablet.cc:2369] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:36:07.739217 13022 tablet.cc:2369] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 01:36:07.740149 13170 tablet.cc:2369] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:07.743005 13115 raft_consensus.cc:1261] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 1 FOLLOWER]: Refusing update from remote peer 4ca6e929da8446fbb9d323af331c082c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:07.743005 12827 raft_consensus.cc:1261] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 1 FOLLOWER]: Refusing update from remote peer 4ca6e929da8446fbb9d323af331c082c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:07.744494 13202 consensus_queue.cc:1035] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a63e63341084ad5b406e415cc8e037b" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:07.744871 13197 consensus_queue.cc:1035] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf108d890f84f37b15c941e65c49648" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:07.758563 13205 mvcc.cc:205] Tried to move back new op lower bound from 7317144239063797760 to 7317144238831726592. Current Snapshot: MvccSnapshot[applied={T|T < 7317144239063797760}]
I20260811 01:36:07.767426 13207 mvcc.cc:205] Tried to move back new op lower bound from 7317144239063797760 to 7317144238831726592. Current Snapshot: MvccSnapshot[applied={T|T < 7317144239063797760}]
I20260811 01:36:07.776446 12667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:07.776860 12667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:07.780793 12667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P db42ac623efa4eed97b5ebf149ffc1ec: Sending DeleteTablet for 3 replicas of tablet 56a4050a542747fba0aac5361a999129
I20260811 01:36:07.782111 12948 tablet_service.cc:1514] Processing DeleteTablet for tablet 56a4050a542747fba0aac5361a999129 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:07 UTC) from {username='slave'} at 127.0.0.1:48448
I20260811 01:36:07.782186 13091 tablet_service.cc:1514] Processing DeleteTablet for tablet 56a4050a542747fba0aac5361a999129 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:07 UTC) from {username='slave'} at 127.0.0.1:58570
I20260811 01:36:07.782737 12801 tablet_service.cc:1514] Processing DeleteTablet for tablet 56a4050a542747fba0aac5361a999129 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:07 UTC) from {username='slave'} at 127.0.0.1:40886
I20260811 01:36:07.785290 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12732
I20260811 01:36:07.801800 13218 tablet_replica.cc:330] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: stopping tablet replica
I20260811 01:36:07.802527 13218 raft_consensus.cc:2229] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:07.802834 13217 tablet_replica.cc:330] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: stopping tablet replica
I20260811 01:36:07.803297 13218 raft_consensus.cc:2258] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:07.804330 13216 tablet_replica.cc:330] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: stopping tablet replica
I20260811 01:36:07.804657 13217 raft_consensus.cc:2229] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:36:07.804802 13216 raft_consensus.cc:2229] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:07.805421 13216 raft_consensus.cc:2258] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:07.805471 13217 raft_consensus.cc:2258] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:07.806103 13218 ts_tablet_manager.cc:1905] T 56a4050a542747fba0aac5361a999129 P daf108d890f84f37b15c941e65c49648: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:07.807662 13217 ts_tablet_manager.cc:1905] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:07.808421 13216 ts_tablet_manager.cc:1905] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:07.810508 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.787185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40894 (local address 127.23.39.193:35319)
0811 01:36:07.787435 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.787444 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.790685 (+ 3241us) server_negotiation.cc:407] Connection header received
0811 01:36:07.791671 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.791682 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.791866 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.791980 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:07.793485 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.795124 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.800177 (+ 5053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.801319 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.801453 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.808591 (+ 7138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:07.808603 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:07.808620 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:07.809430 (+ 810us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:07.809508 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:07.809539 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:07.809641 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.809939 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.810106 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:36:07.812162 12871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:07.815855 13216 ts_tablet_manager.cc:1918] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:07.816279 13216 log.cc:1196] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/56a4050a542747fba0aac5361a999129
I20260811 01:36:07.817003 13216 ts_tablet_manager.cc:1939] T 56a4050a542747fba0aac5361a999129 P 1a63e63341084ad5b406e415cc8e037b: Deleting consensus metadata
I20260811 01:36:07.817252 13217 ts_tablet_manager.cc:1918] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:07.817638 13217 log.cc:1196] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/56a4050a542747fba0aac5361a999129
I20260811 01:36:07.818758 13217 ts_tablet_manager.cc:1939] T 56a4050a542747fba0aac5361a999129 P 4ca6e929da8446fbb9d323af331c082c: Deleting consensus metadata
I20260811 01:36:07.819347 12654 catalog_manager.cc:4841] TS 1a63e63341084ad5b406e415cc8e037b (127.23.39.195:44237): tablet 56a4050a542747fba0aac5361a999129 (table test-table [id=42ee9ac3f3004f96adc1c4de8f2640d2]) successfully deleted
I20260811 01:36:07.820575 12651 catalog_manager.cc:4841] TS 4ca6e929da8446fbb9d323af331c082c (127.23.39.194:33373): tablet 56a4050a542747fba0aac5361a999129 (table test-table [id=42ee9ac3f3004f96adc1c4de8f2640d2]) successfully deleted
I20260811 01:36:07.907925 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12732
W20260811 01:36:07.934795 12652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:35319 (error 108)
I20260811 01:36:07.934996 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12880
I20260811 01:36:07.937647 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.937048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40910)
0811 01:36:07.937317 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.937449 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260811 01:36:07.938069 12652 catalog_manager.cc:4584] TS daf108d890f84f37b15c941e65c49648 (127.23.39.193:35319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56a4050a542747fba0aac5361a999129: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
I20260811 01:36:07.945008 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.936422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.23.39.194:33373)
0811 01:36:07.936623 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:07.936630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:07.936651 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:36:07.936723 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:07.936729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:07.936829 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:07.936930 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:07.937585 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.938773 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.940751 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:07.941448 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:07.941579 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:07.942920 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:07.942932 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:07.942951 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:07.944000 (+ 1049us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:07.944065 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:07.944090 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:07.944214 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:07.944444 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:36:07.944558 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:36:07.945801 13016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:07.992127 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.991614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40922)
0811 01:36:07.991859 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.991950 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 01:36:07.993222 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:07.992843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40926)
0811 01:36:07.993006 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:07.993083 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 01:36:08.053851 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.053251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40928)
0811 01:36:08.053507 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:08.053622 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 01:36:08.055058 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.054670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40936)
0811 01:36:08.054829 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:08.054918 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 01:36:08.061542 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12880
I20260811 01:36:08.086460 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13024
I20260811 01:36:08.093822 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.087283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58572 (local address 127.23.39.195:44237)
0811 01:36:08.087502 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:08.087509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:08.087626 (+ 117us) server_negotiation.cc:407] Connection header received
0811 01:36:08.087851 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:08.087857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:08.087949 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:08.088068 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:08.088509 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:08.089272 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:08.090676 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:08.091081 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:08.091232 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:08.092448 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:08.092458 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:08.092472 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:08.093034 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:08.093082 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:08.093102 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:08.093247 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:08.093374 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:36:08.093491 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:36:08.094596 13163 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:08.135854 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.135243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40938)
0811 01:36:08.135516 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:08.135649 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 01:36:08.137199 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.136703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40950)
0811 01:36:08.136927 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:08.137060 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 01:36:08.186705 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13024
I20260811 01:36:08.208209 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 12636
I20260811 01:36:08.209450 12703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:08.325016 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 12636
I20260811 01:36:08.325065 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:08.324498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:35319 (local address 127.0.0.1:40958)
0811 01:36:08.324738 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:08.324834 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:35319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
2026-08-11T01:36:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2971 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:08 dist-test-slave-9jjr krb5kdc[13228](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:08 dist-test-slave-9jjr krb5kdc[13228](info): set up 2 sockets
Aug 11 01:36:08 dist-test-slave-9jjr krb5kdc[13228](info): commencing operation
krb5kdc: starting...
W20260811 01:36:09.569243 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:09 dist-test-slave-9jjr krb5kdc[13228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:09.926034 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39381
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:10.297505 13242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:10.297906 13242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:10.298070 13242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:10.305862 13242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:10.306051 13242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:10.306200 13242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:10.306304 13242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:10.306393 13242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:10.316854 13242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:10.318444 13242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:10.319873 13242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:10.332432 13247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:10.332413 13248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:10.332655 13250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:10.333315 13242 server_base.cc:1034] running on GCE node
I20260811 01:36:10.334221 13242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:10.335788 13242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:10.337060 13242 hybrid_clock.cc:648] HybridClock initialized: now 1786412170337007 us; error 61 us; skew 500 ppm
I20260811 01:36:10.337495 13242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:10 dist-test-slave-9jjr krb5kdc[13228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412170, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:10.341032 13242 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:10.342933 13242 webserver.cc:460] Webserver started at http://127.23.39.254:35291/ using document root <none> and password file <none>
I20260811 01:36:10.343730 13242 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:10.343895 13242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:10.344237 13242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:10.347582 13242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b457762946e34d43bf9e4bb3131aef69"
format_stamp: "Formatted at 2026-08-11 01:36:10 on dist-test-slave-9jjr"
server_key: "d389975a5f8861f3c610946d8256e37b"
server_key_iv: "0a5e09900f325e21da4dfd99a6551bb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:10.348433 13242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b457762946e34d43bf9e4bb3131aef69"
format_stamp: "Formatted at 2026-08-11 01:36:10 on dist-test-slave-9jjr"
server_key: "d389975a5f8861f3c610946d8256e37b"
server_key_iv: "0a5e09900f325e21da4dfd99a6551bb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:10.354435 13242 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 01:36:10.358433 13257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:10.359858 13242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:10.360074 13242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b457762946e34d43bf9e4bb3131aef69"
format_stamp: "Formatted at 2026-08-11 01:36:10 on dist-test-slave-9jjr"
server_key: "d389975a5f8861f3c610946d8256e37b"
server_key_iv: "0a5e09900f325e21da4dfd99a6551bb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:10.360343 13242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:10.379976 13242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:10.384651 13242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:10.384976 13242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:10.404738 13242 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39381
I20260811 01:36:10.404798 13318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39381 every 8 connection(s)
I20260811 01:36:10.406261 13242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:10.410540 13319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:10.411882 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13242
I20260811 01:36:10.412087 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:10.412712 23711 external_mini_cluster.cc:1428] Setting key f9a3bd7075a24bd9ec3abe47a87cc951
I20260811 01:36:10.428035 13319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: Bootstrap starting.
Aug 11 01:36:10 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:10.432093 13319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:10.433272 13319 log.cc:824] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:10.436848 13319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: No bootstrap required, opened a new log
I20260811 01:36:10.441452 13323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:10.415399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.23.39.254:39381)
0811 01:36:10.416561 (+ 1162us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:10.416580 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:10.416643 (+ 63us) server_negotiation.cc:407] Connection header received
0811 01:36:10.419630 (+ 2987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:10.419665 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:10.420264 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:10.420730 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:10.423005 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:10.425212 (+ 2207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:10.426777 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:10.427544 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:10.427798 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:10.432767 (+ 4969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:10.432778 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:10.432795 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:10.432848 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:10.436405 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:10.437387 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:10.437398 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:10.437406 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:10.437601 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:10.438065 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:10.438070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:10.438072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:10.438863 (+ 791us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:10.439264 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:10.439759 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 01:36:10.440283 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":874,"thread_start_us":515,"threads_started":1}
I20260811 01:36:10.445693 13319 raft_consensus.cc:348] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } }
I20260811 01:36:10.446204 13319 raft_consensus.cc:374] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:10.446324 13319 raft_consensus.cc:729] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b457762946e34d43bf9e4bb3131aef69, State: Initialized, Role: FOLLOWER
I20260811 01:36:10.446913 13319 consensus_queue.cc:260] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } }
I20260811 01:36:10.447182 13319 raft_consensus.cc:388] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:10.447340 13319 raft_consensus.cc:482] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:10.447527 13319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:10.450349 13319 raft_consensus.cc:504] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } }
I20260811 01:36:10.450975 13319 leader_election.cc:302] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b457762946e34d43bf9e4bb3131aef69; no voters:
I20260811 01:36:10.451603 13319 leader_election.cc:288] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:10.451789 13325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:10.452538 13325 raft_consensus.cc:686] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [term 1 LEADER]: Becoming Leader. State: Replica: b457762946e34d43bf9e4bb3131aef69, State: Running, Role: LEADER
I20260811 01:36:10.453155 13325 consensus_queue.cc:237] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } }
I20260811 01:36:10.453963 13319 sys_catalog.cc:564] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:10.456664 13327 sys_catalog.cc:455] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b457762946e34d43bf9e4bb3131aef69. Latest consensus state: current_term: 1 leader_uuid: "b457762946e34d43bf9e4bb3131aef69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } } }
I20260811 01:36:10.457253 13327 sys_catalog.cc:458] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:10.456614 13326 sys_catalog.cc:455] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b457762946e34d43bf9e4bb3131aef69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b457762946e34d43bf9e4bb3131aef69" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39381 } } }
I20260811 01:36:10.457681 13326 sys_catalog.cc:458] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:10.459053 13332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:10.464260 13332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:10.476166 13332 catalog_manager.cc:1347] Generated new cluster ID: f013b237aabc4e35afc5722e52248bd5
I20260811 01:36:10.476372 13332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:10.495735 13332 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:10.497730 13332 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:10.504882 13332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: Generated new TSK 0
I20260811 01:36:10.506011 13332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.39.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
Entry for principal kudu/127.23.39.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab.
I20260811 01:36:10.585261 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:10.954493 13350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:10.954799 13350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:10.954948 13350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:10.962697 13350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:10.962818 13350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:10.962934 13350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:36:10.973191 13350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.193.keytab
--principal=kudu/127.23.39.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:10.974503 13350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:10.975773 13350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:10.989192 13356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:10.989233 13358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:10.989282 13355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:10.990181 13350 server_base.cc:1034] running on GCE node
I20260811 01:36:10.990823 13350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:10.991807 13350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:10.993041 13350 hybrid_clock.cc:648] HybridClock initialized: now 1786412170993005 us; error 65 us; skew 500 ppm
I20260811 01:36:10.993364 13350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:10 dist-test-slave-9jjr krb5kdc[13228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412170, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:11.000527 13350 init.cc:377] Logged in from keytab as kudu/127.23.39.193@KRBTEST.COM (short username kudu)
I20260811 01:36:11.002205 13350 webserver.cc:460] Webserver started at http://127.23.39.193:44581/ using document root <none> and password file <none>
I20260811 01:36:11.002924 13350 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:11.003086 13350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:11.003454 13350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:11.006521 13350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "0d09d7f9e1484856a25cccbc7ed4c990"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "de0976748c3fc0c430bd95cda0b61c57"
server_key_iv: "bfc1c1d1b8087e0f015fa82cfcc1e92c"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.007313 13350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "0d09d7f9e1484856a25cccbc7ed4c990"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "de0976748c3fc0c430bd95cda0b61c57"
server_key_iv: "bfc1c1d1b8087e0f015fa82cfcc1e92c"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.012786 13350 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:11.016364 13366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.017825 13350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:11.018014 13350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "0d09d7f9e1484856a25cccbc7ed4c990"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "de0976748c3fc0c430bd95cda0b61c57"
server_key_iv: "bfc1c1d1b8087e0f015fa82cfcc1e92c"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.018301 13350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:11.030779 13350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:11.035208 13350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:11.035542 13350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:11.036554 13350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:11.037943 13350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:11.038051 13350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.038229 13350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:11.038304 13350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.073933 13350 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:37911
I20260811 01:36:11.073976 13493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:37911 every 8 connection(s)
I20260811 01:36:11.075312 13350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:36:11.080917 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13350
I20260811 01:36:11.081135 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:36:11.081627 23711 external_mini_cluster.cc:1428] Setting key f4235c5ea615eaee1a97bfe78a9c367d
Aug 11 01:36:11 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412170, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.193@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:11.097781 13496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:11.078093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:40709 (local address 127.23.39.254:39381)
0811 01:36:11.078554 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:11.078559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:11.079540 (+ 981us) server_negotiation.cc:407] Connection header received
0811 01:36:11.081542 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:11.081548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:11.081646 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:11.081770 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:11.083728 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.084778 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.086338 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.087037 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.087192 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:11.090835 (+ 3643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:11.090844 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:11.090851 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:11.090897 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:11.094567 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:11.095272 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:11.095280 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:11.095286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:11.095441 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:11.095845 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:11.095852 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:11.095858 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:11.096253 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:11.096409 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:11.097034 (+ 625us) server_negotiation.cc:299] Negotiation successful
0811 01:36:11.097301 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":212,"threads_started":1}
I20260811 01:36:11.098388 13497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:11.078690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39381 (local address 127.23.39.193:40709)
0811 01:36:11.079385 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:11.079422 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:11.081266 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:11.082009 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:11.082018 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:11.082716 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:11.083516 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:11.083542 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.084926 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.084929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:11.086172 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:11.086197 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.087252 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.087257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:11.087455 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:11.088157 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:11.088180 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:11.090599 (+ 2419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:11.094702 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:11.094708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:11.094721 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:11.095141 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:11.095545 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:11.095548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:11.095550 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:11.095726 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:11.096372 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:11.096378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:11.096669 (+ 291us) client_negotiation.cc:769] Sending connection context
0811 01:36:11.096884 (+ 215us) client_negotiation.cc:240] Negotiation successful
0811 01:36:11.097260 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":276,"threads_started":1}
I20260811 01:36:11.100071 13494 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39381
I20260811 01:36:11.100401 13494 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:11.101081 13494 heartbeater.cc:511] Master 127.23.39.254:39381 requested a full tablet report, sending...
I20260811 01:36:11.103536 13279 ts_manager.cc:194] Registered new tserver with Master: 0d09d7f9e1484856a25cccbc7ed4c990 (127.23.39.193:37911)
I20260811 01:36:11.105291 13279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.193@KRBTEST.COM'} at 127.23.39.193:40709
WARNING: no policy specified for kudu/127.23.39.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
Entry for principal kudu/127.23.39.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab.
I20260811 01:36:11.166697 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:11.512514 13500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:11.512854 13500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:11.513027 13500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:11.521013 13500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:11.521214 13500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:11.521420 13500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:36:11.531929 13500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.194.keytab
--principal=kudu/127.23.39.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:11.533324 13500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:11.534696 13500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:11.547948 13507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:11.548053 13510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:11.548019 13508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:11.549585 13500 server_base.cc:1034] running on GCE node
I20260811 01:36:11.550352 13500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:11.551399 13500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:11.552708 13500 hybrid_clock.cc:648] HybridClock initialized: now 1786412171552645 us; error 76 us; skew 500 ppm
I20260811 01:36:11.553156 13500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:11 dist-test-slave-9jjr krb5kdc[13228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412171, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:11.557109 13500 init.cc:377] Logged in from keytab as kudu/127.23.39.194@KRBTEST.COM (short username kudu)
I20260811 01:36:11.558907 13500 webserver.cc:460] Webserver started at http://127.23.39.194:45625/ using document root <none> and password file <none>
I20260811 01:36:11.559636 13500 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:11.559742 13500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:11.560099 13500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:11.563203 13500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "9d206505bb2940249f6231f47f7b3d27"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "f6be7e5268b8b73e37e9fe4679d0c3f4"
server_key_iv: "246667e805a55826b3fead0de59581b0"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.564024 13500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "9d206505bb2940249f6231f47f7b3d27"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "f6be7e5268b8b73e37e9fe4679d0c3f4"
server_key_iv: "246667e805a55826b3fead0de59581b0"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.569341 13500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:36:11.572860 13521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.574270 13500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:11.574446 13500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "9d206505bb2940249f6231f47f7b3d27"
format_stamp: "Formatted at 2026-08-11 01:36:11 on dist-test-slave-9jjr"
server_key: "f6be7e5268b8b73e37e9fe4679d0c3f4"
server_key_iv: "246667e805a55826b3fead0de59581b0"
server_key_version: "encryptionkey@0"
I20260811 01:36:11.574646 13500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:11.595255 13500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:11.599817 13500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:11.600167 13500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:11.601176 13500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:11.602727 13500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:11.602799 13500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.602968 13500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:11.603035 13500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:11.639014 13500 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:44797
I20260811 01:36:11.639112 13645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:44797 every 8 connection(s)
I20260811 01:36:11.640515 13500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:36:11.650715 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13500
I20260811 01:36:11.650938 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:36:11.651479 23711 external_mini_cluster.cc:1428] Setting key dc94547842929d141dc3d46c53fae9de
Aug 11 01:36:11 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412171, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.194@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:11.664620 13648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:11.643377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:52891 (local address 127.23.39.254:39381)
0811 01:36:11.643894 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:11.643899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:11.644670 (+ 771us) server_negotiation.cc:407] Connection header received
0811 01:36:11.646863 (+ 2193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:11.646870 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:11.646977 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:11.647310 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:11.648922 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.649685 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.651444 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.651974 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.652147 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:11.656780 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:11.656792 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:11.656800 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:11.656854 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:11.660865 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:11.661647 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:11.661655 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:11.661662 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:11.661840 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:11.662350 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:11.662358 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:11.662365 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:11.662797 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:11.662980 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:11.663738 (+ 758us) server_negotiation.cc:299] Negotiation successful
0811 01:36:11.664028 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":293,"threads_started":1}
I20260811 01:36:11.665446 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:11.643748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39381 (local address 127.23.39.194:52891)
0811 01:36:11.644496 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:11.644540 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:11.646563 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:11.647563 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:11.647571 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:11.648144 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:11.648728 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:11.648746 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.649854 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.649858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:11.651294 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:11.651307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:11.652302 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:11.652310 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:11.652657 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:11.653513 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:11.653557 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:11.656519 (+ 2962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:11.661032 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:11.661039 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:11.661053 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:11.661500 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:11.661959 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:11.661962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:11.661964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:11.662220 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:11.662935 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:11.662940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:11.663297 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 01:36:11.663526 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 01:36:11.664090 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":297,"threads_started":1}
I20260811 01:36:11.667068 13646 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39381
I20260811 01:36:11.667421 13646 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:11.668139 13646 heartbeater.cc:511] Master 127.23.39.254:39381 requested a full tablet report, sending...
I20260811 01:36:11.669708 13279 ts_manager.cc:194] Registered new tserver with Master: 9d206505bb2940249f6231f47f7b3d27 (127.23.39.194:44797)
I20260811 01:36:11.670747 13279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.194@KRBTEST.COM'} at 127.23.39.194:52891
WARNING: no policy specified for kudu/127.23.39.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
Entry for principal kudu/127.23.39.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab.
I20260811 01:36:11.729465 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:33427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:12.083357 13654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:12.083715 13654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:12.083886 13654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:12.091537 13654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:12.091732 13654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:12.091934 13654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:36:12.102430 13654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:33427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.195.keytab
--principal=kudu/127.23.39.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:12.103850 13654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:12.105198 13654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 01:36:12.109077 13494 heartbeater.cc:503] Master 127.23.39.254:39381 was elected leader, sending a full tablet report...
W20260811 01:36:12.119650 13659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:12.119707 13662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:12.119736 13660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:12.120764 13654 server_base.cc:1034] running on GCE node
I20260811 01:36:12.121483 13654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:12.122653 13654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:12.123883 13654 hybrid_clock.cc:648] HybridClock initialized: now 1786412172123815 us; error 60 us; skew 500 ppm
I20260811 01:36:12.124176 13654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:12 dist-test-slave-9jjr krb5kdc[13228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412172, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:12.127578 13654 init.cc:377] Logged in from keytab as kudu/127.23.39.195@KRBTEST.COM (short username kudu)
I20260811 01:36:12.129062 13654 webserver.cc:460] Webserver started at http://127.23.39.195:35783/ using document root <none> and password file <none>
I20260811 01:36:12.129746 13654 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:12.129853 13654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:12.130121 13654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:12.133308 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "d0796410e42844f6bdc65425c92422d7"
format_stamp: "Formatted at 2026-08-11 01:36:12 on dist-test-slave-9jjr"
server_key: "d76e4bad236a129024819575055f352e"
server_key_iv: "c91bc154c55ec88e112b67c5df02dba5"
server_key_version: "encryptionkey@0"
I20260811 01:36:12.134117 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "d0796410e42844f6bdc65425c92422d7"
format_stamp: "Formatted at 2026-08-11 01:36:12 on dist-test-slave-9jjr"
server_key: "d76e4bad236a129024819575055f352e"
server_key_iv: "c91bc154c55ec88e112b67c5df02dba5"
server_key_version: "encryptionkey@0"
I20260811 01:36:12.139725 13654 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 01:36:12.143646 13671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:12.145090 13654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:12.145292 13654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "d0796410e42844f6bdc65425c92422d7"
format_stamp: "Formatted at 2026-08-11 01:36:12 on dist-test-slave-9jjr"
server_key: "d76e4bad236a129024819575055f352e"
server_key_iv: "c91bc154c55ec88e112b67c5df02dba5"
server_key_version: "encryptionkey@0"
I20260811 01:36:12.145514 13654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:12.162937 13654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:12.167989 13654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:12.168320 13654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:12.169420 13654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:12.170979 13654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:12.171092 13654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:12.171255 13654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:12.171358 13654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:12.207072 13654 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:44403
I20260811 01:36:12.207135 13792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:44403 every 8 connection(s)
I20260811 01:36:12.208550 13654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:36:12.214697 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13654
I20260811 01:36:12.214910 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:36:12.215379 23711 external_mini_cluster.cc:1428] Setting key fd446187094038ba0eabbf5f2f751f04
Aug 11 01:36:12 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412172, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.195@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:12.229996 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.211344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:46515 (local address 127.23.39.254:39381)
0811 01:36:12.211865 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.211870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.212770 (+ 900us) server_negotiation.cc:407] Connection header received
0811 01:36:12.214793 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.214800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.214917 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.215043 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:12.216940 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.218042 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.219754 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.220148 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.220252 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.223967 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:12.223972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:12.223975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:12.224008 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:12.226664 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.227479 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.227484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.227486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.227613 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.228119 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.228123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.228125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.228411 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:12.228595 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.229331 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.229569 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":267,"threads_started":1}
I20260811 01:36:12.231248 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.211739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39381 (local address 127.23.39.195:46515)
0811 01:36:12.212579 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.212633 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.214483 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.215346 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.215356 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.215937 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:12.216767 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.216789 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.218261 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.218267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.219611 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.219624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.220372 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.220377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.220584 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.221309 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:12.221333 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:12.223731 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:12.226835 (+ 3104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:12.226845 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:12.226864 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:12.227334 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:12.227759 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:12.227764 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:12.227768 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:12.227981 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:12.228562 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:12.228571 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:12.228943 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.229225 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.229809 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":282,"threads_started":1}
I20260811 01:36:12.232576 13793 heartbeater.cc:347] Connected to a master server at 127.23.39.254:39381
I20260811 01:36:12.232904 13793 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:12.233681 13793 heartbeater.cc:511] Master 127.23.39.254:39381 requested a full tablet report, sending...
I20260811 01:36:12.235200 13279 ts_manager.cc:194] Registered new tserver with Master: d0796410e42844f6bdc65425c92422d7 (127.23.39.195:44403)
I20260811 01:36:12.236045 13279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.39.195@KRBTEST.COM'} at 127.23.39.195:46515
I20260811 01:36:12.243527 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:36:12.261245 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.247858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.23.39.254:39381)
0811 01:36:12.248093 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.248103 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.248493 (+ 390us) server_negotiation.cc:407] Connection header received
0811 01:36:12.248634 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.248638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.248720 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.248843 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:12.250465 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.251207 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.252491 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.252891 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.252985 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.255693 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:12.255698 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:12.255702 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:12.255740 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:12.258612 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.259366 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.259370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.259372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.259508 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.259872 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.259875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.259877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.260206 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:12.260390 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.260697 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.260877 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:36:12.265430 13279 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:36:12.272545 13279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:36:12.300606 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.285000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:44403 (local address 127.0.0.1:46710)
0811 01:36:12.285763 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.285806 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.285998 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.293275 (+ 7277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.293279 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.293307 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:12.293677 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.293688 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.295206 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.295211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.297674 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.297696 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.299445 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.299452 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.299674 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.299737 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.299878 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.300095 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":339,"thread_start_us":1689,"threads_started":1}
I20260811 01:36:12.301282 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.285793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:37911 (local address 127.0.0.1:60188)
0811 01:36:12.291222 (+ 5429us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.291244 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.291386 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.292437 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.292448 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.292480 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:12.292966 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.292979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.295141 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.295147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.298449 (+ 3302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.298466 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.300391 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.300397 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.300581 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.300622 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.300724 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.300862 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5313,"mutex_wait_us":269,"spinlock_wait_cycles":1280,"thread_start_us":5172,"threads_started":1}
I20260811 01:36:12.301702 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.285600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46710 (local address 127.23.39.195:44403)
0811 01:36:12.292660 (+ 7060us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.292671 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.292717 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:36:12.292817 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.292828 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.293055 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.293282 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:12.293854 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.295025 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.297871 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.299233 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.299371 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.299621 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.301191 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.301402 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6862,"thread_start_us":7287,"threads_started":1}
I20260811 01:36:12.301831 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.286503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60188 (local address 127.23.39.193:37911)
0811 01:36:12.290769 (+ 4266us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.290782 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.291531 (+ 749us) server_negotiation.cc:407] Connection header received
0811 01:36:12.291663 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.291672 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.291952 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.292161 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:12.293166 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.294977 (+ 1811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.298655 (+ 3678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.300160 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.300315 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.300540 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.301066 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.301249 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4023,"thread_start_us":3859,"threads_started":1}
I20260811 01:36:12.303820 13808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.285026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:44797 (local address 127.0.0.1:48684)
0811 01:36:12.286610 (+ 1584us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.286627 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.286761 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.292242 (+ 5481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.292252 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.292284 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:12.292826 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.292845 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.295141 (+ 2296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.295147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.298449 (+ 3302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.298466 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.301774 (+ 3308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.301781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.303087 (+ 1306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.303112 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.303264 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.303405 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1457,"mutex_wait_us":259,"spinlock_wait_cycles":9216,"thread_start_us":1330,"threads_started":1}
I20260811 01:36:12.303841 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.285062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48684 (local address 127.23.39.194:44797)
0811 01:36:12.291639 (+ 6577us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.291647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.291671 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:36:12.291754 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.291760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.291950 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.293079 (+ 1129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:12.293401 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.294973 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.299751 (+ 4778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.301278 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.301439 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.301629 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.303317 (+ 1688us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.303488 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6401,"thread_start_us":6278,"threads_started":1}
I20260811 01:36:12.305759 13421 tablet_service.cc:1467] Processing CreateTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 (DEFAULT_TABLE table=test-table [id=a1cf960cffbf4653914084bcbcf4a204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:12.307121 13421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8199adeaf1ba42d6956b823bda4ed055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:12.307444 13576 tablet_service.cc:1467] Processing CreateTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 (DEFAULT_TABLE table=test-table [id=a1cf960cffbf4653914084bcbcf4a204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:12.307842 13724 tablet_service.cc:1467] Processing CreateTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 (DEFAULT_TABLE table=test-table [id=a1cf960cffbf4653914084bcbcf4a204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:12.308878 13576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8199adeaf1ba42d6956b823bda4ed055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:12.309237 13724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8199adeaf1ba42d6956b823bda4ed055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:12.319766 13812 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Bootstrap starting.
I20260811 01:36:12.323568 13812 tablet_bootstrap.cc:654] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:12.325057 13812 log.cc:824] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:12.325127 13814 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Bootstrap starting.
I20260811 01:36:12.326915 13813 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Bootstrap starting.
I20260811 01:36:12.329128 13814 tablet_bootstrap.cc:654] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:12.330204 13813 tablet_bootstrap.cc:654] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:12.330519 13814 log.cc:824] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:12.330765 13812 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: No bootstrap required, opened a new log
I20260811 01:36:12.331046 13812 ts_tablet_manager.cc:1397] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260811 01:36:12.331521 13813 log.cc:824] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:12.334147 13814 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: No bootstrap required, opened a new log
I20260811 01:36:12.334569 13814 ts_tablet_manager.cc:1397] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 01:36:12.338878 13812 raft_consensus.cc:348] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.339275 13812 raft_consensus.cc:374] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:12.339389 13812 raft_consensus.cc:729] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d09d7f9e1484856a25cccbc7ed4c990, State: Initialized, Role: FOLLOWER
I20260811 01:36:12.340209 13812 consensus_queue.cc:260] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.342106 13812 ts_tablet_manager.cc:1428] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260811 01:36:12.342589 13813 tablet_bootstrap.cc:492] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: No bootstrap required, opened a new log
I20260811 01:36:12.342888 13813 ts_tablet_manager.cc:1397] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260811 01:36:12.346335 13814 raft_consensus.cc:348] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.346791 13814 raft_consensus.cc:374] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:12.346894 13814 raft_consensus.cc:729] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d206505bb2940249f6231f47f7b3d27, State: Initialized, Role: FOLLOWER
I20260811 01:36:12.347543 13814 consensus_queue.cc:260] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.348631 13646 heartbeater.cc:503] Master 127.23.39.254:39381 was elected leader, sending a full tablet report...
I20260811 01:36:12.349411 13814 ts_tablet_manager.cc:1428] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260811 01:36:12.352823 13813 raft_consensus.cc:348] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.353289 13813 raft_consensus.cc:374] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:12.353366 13813 raft_consensus.cc:729] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0796410e42844f6bdc65425c92422d7, State: Initialized, Role: FOLLOWER
I20260811 01:36:12.353854 13813 consensus_queue.cc:260] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.354880 13793 heartbeater.cc:503] Master 127.23.39.254:39381 was elected leader, sending a full tablet report...
I20260811 01:36:12.355394 13813 ts_tablet_manager.cc:1428] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260811 01:36:12.388119 13819 raft_consensus.cc:482] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:36:12.388402 13819 raft_consensus.cc:504] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.390049 13819 leader_election.cc:288] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0796410e42844f6bdc65425c92422d7 (127.23.39.195:44403), 0d09d7f9e1484856a25cccbc7ed4c990 (127.23.39.193:37911)
W20260811 01:36:12.392589 13647 tablet.cc:2369] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:12.400521 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.390653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:57635 (local address 127.23.39.195:44403)
0811 01:36:12.390863 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.390870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.391614 (+ 744us) server_negotiation.cc:407] Connection header received
0811 01:36:12.391877 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.391882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.391964 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.392029 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:12.393461 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.394680 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.397949 (+ 3269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.399283 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.399452 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.399531 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.400134 (+ 603us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.400273 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:36:12.400525 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.390674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:52871 (local address 127.23.39.193:37911)
0811 01:36:12.390914 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.390920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.392326 (+ 1406us) server_negotiation.cc:407] Connection header received
0811 01:36:12.392537 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.392544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.392630 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.392734 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:12.393614 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.394726 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.397950 (+ 3224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.399233 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.399466 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.399535 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.400125 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.400266 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:36:12.400808 13822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.390630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:44403 (local address 127.23.39.194:57635)
0811 01:36:12.391467 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.391488 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.391651 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.392254 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.392258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.392873 (+ 615us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:12.393299 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.393312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.394886 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.394890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.397755 (+ 2865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.397771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.399612 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.399619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.399876 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.399967 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.400079 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.400238 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":258,"thread_start_us":470,"threads_started":1}
I20260811 01:36:12.400835 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.390642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:37911 (local address 127.23.39.194:52871)
0811 01:36:12.392191 (+ 1549us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:12.392218 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:12.392358 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:12.392773 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:12.392778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:12.392802 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:12.393417 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.393433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.394885 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.394890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.397755 (+ 2865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:12.397771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.399614 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.399619 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:12.399858 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.399966 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 01:36:12.400079 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 01:36:12.400238 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1411,"mutex_wait_us":303,"spinlock_wait_cycles":19712,"thread_start_us":1164,"threads_started":1}
I20260811 01:36:12.402006 13747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8199adeaf1ba42d6956b823bda4ed055" candidate_uuid: "9d206505bb2940249f6231f47f7b3d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0796410e42844f6bdc65425c92422d7" is_pre_election: true
I20260811 01:36:12.401993 13444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8199adeaf1ba42d6956b823bda4ed055" candidate_uuid: "9d206505bb2940249f6231f47f7b3d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" is_pre_election: true
I20260811 01:36:12.402657 13747 raft_consensus.cc:2454] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d206505bb2940249f6231f47f7b3d27 in term 0.
I20260811 01:36:12.402645 13444 raft_consensus.cc:2454] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d206505bb2940249f6231f47f7b3d27 in term 0.
I20260811 01:36:12.403378 13523 leader_election.cc:302] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d206505bb2940249f6231f47f7b3d27, d0796410e42844f6bdc65425c92422d7; no voters:
I20260811 01:36:12.403774 13819 raft_consensus.cc:2781] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:36:12.403946 13819 raft_consensus.cc:482] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:36:12.404096 13819 raft_consensus.cc:3037] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:12.407297 13819 raft_consensus.cc:504] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.407953 13819 leader_election.cc:288] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [CANDIDATE]: Term 1 election: Requested vote from peers d0796410e42844f6bdc65425c92422d7 (127.23.39.195:44403), 0d09d7f9e1484856a25cccbc7ed4c990 (127.23.39.193:37911)
I20260811 01:36:12.408480 13444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8199adeaf1ba42d6956b823bda4ed055" candidate_uuid: "9d206505bb2940249f6231f47f7b3d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d09d7f9e1484856a25cccbc7ed4c990"
I20260811 01:36:12.408484 13747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8199adeaf1ba42d6956b823bda4ed055" candidate_uuid: "9d206505bb2940249f6231f47f7b3d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0796410e42844f6bdc65425c92422d7"
I20260811 01:36:12.408697 13444 raft_consensus.cc:3037] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:12.408686 13747 raft_consensus.cc:3037] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:12.411280 13444 raft_consensus.cc:2454] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d206505bb2940249f6231f47f7b3d27 in term 1.
I20260811 01:36:12.411815 13525 leader_election.cc:302] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d09d7f9e1484856a25cccbc7ed4c990, 9d206505bb2940249f6231f47f7b3d27; no voters:
I20260811 01:36:12.411972 13747 raft_consensus.cc:2454] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d206505bb2940249f6231f47f7b3d27 in term 1.
I20260811 01:36:12.412212 13819 raft_consensus.cc:2781] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:12.412849 13819 raft_consensus.cc:686] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d206505bb2940249f6231f47f7b3d27, State: Running, Role: LEADER
I20260811 01:36:12.413441 13819 consensus_queue.cc:237] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } }
I20260811 01:36:12.418634 13279 catalog_manager.cc:5495] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d206505bb2940249f6231f47f7b3d27 (127.23.39.194). New cstate: current_term: 1 leader_uuid: "9d206505bb2940249f6231f47f7b3d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d206505bb2940249f6231f47f7b3d27" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 44797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 } health_report { overall_health: UNKNOWN } } }
I20260811 01:36:12.459375 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.453783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.23.39.194:44797)
0811 01:36:12.454006 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.454012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.454032 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:36:12.454265 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.454269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.454357 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.454483 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:12.454988 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.455750 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.457136 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.457538 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.457629 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.458222 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:12.458732 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:12.458851 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.458979 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.459047 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 01:36:12.460309 13794 tablet.cc:2369] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:12.468467 13747 raft_consensus.cc:1261] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 1 FOLLOWER]: Refusing update from remote peer 9d206505bb2940249f6231f47f7b3d27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:12.468466 13444 raft_consensus.cc:1261] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 1 FOLLOWER]: Refusing update from remote peer 9d206505bb2940249f6231f47f7b3d27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:12.469588 13825 consensus_queue.cc:1035] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d09d7f9e1484856a25cccbc7ed4c990" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 37911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:12.469981 13819 consensus_queue.cc:1035] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0796410e42844f6bdc65425c92422d7" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 44403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:12.482883 13832 mvcc.cc:205] Tried to move back new op lower bound from 7317144258419556352 to 7317144258209980416. Current Snapshot: MvccSnapshot[applied={T|T < 7317144258419556352}]
I20260811 01:36:12.497330 13279 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:12.497586 13279 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:12.501593 13279 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b457762946e34d43bf9e4bb3131aef69: Sending DeleteTablet for 3 replicas of tablet 8199adeaf1ba42d6956b823bda4ed055
I20260811 01:36:12.503013 13576 tablet_service.cc:1514] Processing DeleteTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:12 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:48684
I20260811 01:36:12.503028 13724 tablet_service.cc:1514] Processing DeleteTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:12 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:46710
I20260811 01:36:12.503185 13421 tablet_service.cc:1514] Processing DeleteTablet for tablet 8199adeaf1ba42d6956b823bda4ed055 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:12 UTC) from {username='kudu', principal='kudu/127.23.39.254@KRBTEST.COM'} at 127.0.0.1:60188
I20260811 01:36:12.504976 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13350
I20260811 01:36:12.517750 13842 tablet_replica.cc:330] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: stopping tablet replica
I20260811 01:36:12.518062 13841 tablet_replica.cc:330] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: stopping tablet replica
I20260811 01:36:12.518368 13842 raft_consensus.cc:2229] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:12.518663 13841 raft_consensus.cc:2229] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:12.518953 13842 raft_consensus.cc:2258] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:12.519250 13841 raft_consensus.cc:2258] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:12.521485 13841 ts_tablet_manager.cc:1905] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:12.521570 13842 ts_tablet_manager.cc:1905] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:12.522343 13840 tablet_replica.cc:330] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: stopping tablet replica
I20260811 01:36:12.522732 13840 raft_consensus.cc:2229] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:36:12.523443 13840 raft_consensus.cc:2258] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:12.525586 13840 ts_tablet_manager.cc:1905] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:12.529088 13841 ts_tablet_manager.cc:1918] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:12.529309 13841 log.cc:1196] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/8199adeaf1ba42d6956b823bda4ed055
I20260811 01:36:12.529951 13841 ts_tablet_manager.cc:1939] T 8199adeaf1ba42d6956b823bda4ed055 P d0796410e42844f6bdc65425c92422d7: Deleting consensus metadata
Aug 11 01:36:12 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.193@KRBTEST.COM
I20260811 01:36:12.532054 13259 catalog_manager.cc:4841] TS d0796410e42844f6bdc65425c92422d7 (127.23.39.195:44403): tablet 8199adeaf1ba42d6956b823bda4ed055 (table test-table [id=a1cf960cffbf4653914084bcbcf4a204]) successfully deleted
I20260811 01:36:12.535579 13842 ts_tablet_manager.cc:1918] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:12.535751 13842 log.cc:1196] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-0/wal/wals/8199adeaf1ba42d6956b823bda4ed055
I20260811 01:36:12.536350 13842 ts_tablet_manager.cc:1939] T 8199adeaf1ba42d6956b823bda4ed055 P 0d09d7f9e1484856a25cccbc7ed4c990: Deleting consensus metadata
I20260811 01:36:12.538002 13840 ts_tablet_manager.cc:1918] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:12.538256 13840 log.cc:1196] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/8199adeaf1ba42d6956b823bda4ed055
I20260811 01:36:12.538398 13260 catalog_manager.cc:4841] TS 0d09d7f9e1484856a25cccbc7ed4c990 (127.23.39.193:37911): tablet 8199adeaf1ba42d6956b823bda4ed055 (table test-table [id=a1cf960cffbf4653914084bcbcf4a204]) successfully deleted
I20260811 01:36:12.538955 13840 ts_tablet_manager.cc:1939] T 8199adeaf1ba42d6956b823bda4ed055 P 9d206505bb2940249f6231f47f7b3d27: Deleting consensus metadata
I20260811 01:36:12.540164 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.506876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60200 (local address 127.23.39.193:37911)
0811 01:36:12.507110 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.507119 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.517295 (+ 10176us) server_negotiation.cc:407] Connection header received
0811 01:36:12.518343 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.518355 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.518451 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.518537 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:12.522240 (+ 3703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.523387 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.525333 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.525931 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.526051 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.531993 (+ 5942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:12.532007 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:12.532025 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:12.532081 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:12.536492 (+ 4411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.537471 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.537481 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.537484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.537660 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.538189 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.538197 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.538202 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.538671 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:12.538943 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.539544 (+ 601us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.539766 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:36:12.540740 13258 catalog_manager.cc:4841] TS 9d206505bb2940249f6231f47f7b3d27 (127.23.39.194:44797): tablet 8199adeaf1ba42d6956b823bda4ed055 (table test-table [id=a1cf960cffbf4653914084bcbcf4a204]) successfully deleted
I20260811 01:36:12.541229 13489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:12.634660 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13350
I20260811 01:36:12.662424 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13500
Aug 11 01:36:12 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.194@KRBTEST.COM
I20260811 01:36:12.681304 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.663447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48706 (local address 127.23.39.194:44797)
0811 01:36:12.664135 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.664142 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.664162 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:36:12.664231 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.664236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.664314 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.664461 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:12.666452 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.667756 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.669036 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.669719 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.669872 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.674791 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:12.674807 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:12.674825 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:12.674871 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:12.678240 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.679145 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.679156 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.679160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.679345 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.679805 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.679812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.679814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.680174 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:12.680430 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.680792 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.680968 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553}
I20260811 01:36:12.682080 13641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:12.799192 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13500
I20260811 01:36:12.821801 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13654
Aug 11 01:36:12 dist-test-slave-9jjr krb5kdc[13228](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.195@KRBTEST.COM
I20260811 01:36:12.888623 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:12.822659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46712 (local address 127.23.39.195:44403)
0811 01:36:12.822872 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:12.822877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:12.822896 (+ 19us) server_negotiation.cc:407] Connection header received
0811 01:36:12.823030 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:12.823034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:12.823166 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:12.823264 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:12.824631 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.825409 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.826835 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:12.827237 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:12.827331 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:12.883123 (+ 55792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:12.883143 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:12.883160 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:12.883207 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:12.885945 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.886742 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.886749 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.886751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.886901 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:12.887270 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:12.887273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:12.887275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:12.887644 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:12.887885 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:12.888157 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 01:36:12.888352 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:36:12.889292 13788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:12.983340 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13654
I20260811 01:36:13.003562 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13242
I20260811 01:36:13.004735 13313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:13.118754 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13242
2026-08-11T01:36:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4793 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T01:36:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:13Z Disabled control of system clock
I20260811 01:36:13.216650 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42619
--webserver_interface=127.23.39.254
--webserver_port=0
--builtin_ntp_servers=127.23.39.212:32863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:42619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:36:13.569551 13852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:13.569839 13852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:13.570007 13852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:13.577468 13852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:13.577576 13852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:13.577643 13852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:13.577734 13852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:13.577805 13852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:13.587333 13852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:32863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:42619
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:42619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:13.588660 13852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:13.590533 13852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:13.602803 13861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:13.602845 13865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:13.602785 13862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:13.603426 13852 server_base.cc:1034] running on GCE node
I20260811 01:36:13.604313 13852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:13.605779 13852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:13.607018 13852 hybrid_clock.cc:648] HybridClock initialized: now 1786412173606980 us; error 52 us; skew 500 ppm
I20260811 01:36:13.607383 13852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:13.609714 13852 webserver.cc:460] Webserver started at http://127.23.39.254:42171/ using document root <none> and password file <none>
I20260811 01:36:13.610483 13852 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:13.610616 13852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:13.610941 13852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:13.613831 13852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "d140969516c64fe0b82e7321f2b66d68"
format_stamp: "Formatted at 2026-08-11 01:36:13 on dist-test-slave-9jjr"
server_key: "e3507c9f1db5dbd0d409152f70f3d5c3"
server_key_iv: "acf83f02e2315683aa887dd68af6ce8f"
server_key_version: "encryptionkey@0"
I20260811 01:36:13.614697 13852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "d140969516c64fe0b82e7321f2b66d68"
format_stamp: "Formatted at 2026-08-11 01:36:13 on dist-test-slave-9jjr"
server_key: "e3507c9f1db5dbd0d409152f70f3d5c3"
server_key_iv: "acf83f02e2315683aa887dd68af6ce8f"
server_key_version: "encryptionkey@0"
I20260811 01:36:13.619808 13852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:13.623317 13871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:13.624564 13852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:36:13.624756 13852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "d140969516c64fe0b82e7321f2b66d68"
format_stamp: "Formatted at 2026-08-11 01:36:13 on dist-test-slave-9jjr"
server_key: "e3507c9f1db5dbd0d409152f70f3d5c3"
server_key_iv: "acf83f02e2315683aa887dd68af6ce8f"
server_key_version: "encryptionkey@0"
I20260811 01:36:13.624984 13852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:13.658838 13852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:13.659773 13852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:13.660086 13852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:13.679833 13852 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:42619
I20260811 01:36:13.679876 13926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:42619 every 8 connection(s)
I20260811 01:36:13.681252 13852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:13.685014 13927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:13.688457 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13852
I20260811 01:36:13.688653 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:13.689221 23711 external_mini_cluster.cc:1428] Setting key c97a56b5379ff1fafe233f055ad9ffe9
I20260811 01:36:13.698247 13927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: Bootstrap starting.
I20260811 01:36:13.701973 13927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:13.703161 13927 log.cc:824] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:13.703780 13930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:13.691371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.23.39.254:42619)
0811 01:36:13.692428 (+ 1057us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:13.692439 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:13.692485 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:36:13.694120 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:13.694206 (+ 86us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:13.694703 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:13.695034 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:13.695664 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:13.696963 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:13.698909 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:13.699630 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:13.699787 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:13.701149 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:13.701156 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:13.701169 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:13.701715 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:13.701814 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:13.701835 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:13.701923 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:13.702323 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 01:36:13.702669 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":405,"threads_started":1}
I20260811 01:36:13.706422 13927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: No bootstrap required, opened a new log
I20260811 01:36:13.713654 13927 raft_consensus.cc:348] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } }
I20260811 01:36:13.714056 13927 raft_consensus.cc:374] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:13.714219 13927 raft_consensus.cc:729] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d140969516c64fe0b82e7321f2b66d68, State: Initialized, Role: FOLLOWER
I20260811 01:36:13.714937 13927 consensus_queue.cc:260] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } }
I20260811 01:36:13.715252 13927 raft_consensus.cc:388] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:13.715415 13927 raft_consensus.cc:482] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:13.715613 13927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:13.717922 13927 raft_consensus.cc:504] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } }
I20260811 01:36:13.718528 13927 leader_election.cc:302] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d140969516c64fe0b82e7321f2b66d68; no voters:
I20260811 01:36:13.719161 13927 leader_election.cc:288] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:13.719309 13932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:13.720898 13932 raft_consensus.cc:686] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [term 1 LEADER]: Becoming Leader. State: Replica: d140969516c64fe0b82e7321f2b66d68, State: Running, Role: LEADER
I20260811 01:36:13.721501 13927 sys_catalog.cc:564] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:13.721541 13932 consensus_queue.cc:237] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } }
I20260811 01:36:13.725020 13934 sys_catalog.cc:455] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d140969516c64fe0b82e7321f2b66d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } } }
I20260811 01:36:13.724933 13935 sys_catalog.cc:455] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d140969516c64fe0b82e7321f2b66d68. Latest consensus state: current_term: 1 leader_uuid: "d140969516c64fe0b82e7321f2b66d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d140969516c64fe0b82e7321f2b66d68" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 42619 } } }
I20260811 01:36:13.725545 13935 sys_catalog.cc:458] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:13.725543 13934 sys_catalog.cc:458] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:13.727945 13944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:13.733992 13944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:13.743400 13944 catalog_manager.cc:1347] Generated new cluster ID: 49a537cb17d44026a33e8cf520fd0493
I20260811 01:36:13.743533 13944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:13.767082 13944 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:13.768397 13944 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:13.774837 13944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: Generated new TSK 0
I20260811 01:36:13.776013 13944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:13.787890 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.193:0
--local_ip_for_outbound_sockets=127.23.39.193
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--builtin_ntp_servers=127.23.39.212:32863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 01:36:14.144097 13953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:14.144407 13953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:14.144546 13953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:14.152168 13953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:14.152274 13953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:14.152439 13953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.193
I20260811 01:36:14.161742 13953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:32863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.39.193
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.193
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:14.163158 13953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:14.165005 13953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:14.178962 13960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:14.178900 13961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:14.179472 13963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:14.180061 13953 server_base.cc:1034] running on GCE node
I20260811 01:36:14.180763 13953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:14.181787 13953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:14.183032 13953 hybrid_clock.cc:648] HybridClock initialized: now 1786412174182969 us; error 46 us; skew 500 ppm
I20260811 01:36:14.183434 13953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:14.185850 13953 webserver.cc:460] Webserver started at http://127.23.39.193:36419/ using document root <none> and password file <none>
I20260811 01:36:14.186635 13953 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:14.186775 13953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:14.187104 13953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:14.190217 13953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data/instance:
uuid: "78603555e45443f5b0fcbee63fe9f357"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "954ec8e66f686bad348f36fd404422fa"
server_key_iv: "a16d234bac2a74895fa030ef7751565b"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.191073 13953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance:
uuid: "78603555e45443f5b0fcbee63fe9f357"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "954ec8e66f686bad348f36fd404422fa"
server_key_iv: "a16d234bac2a74895fa030ef7751565b"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.196632 13953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:14.200645 13969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.202108 13953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:14.202395 13953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal
uuid: "78603555e45443f5b0fcbee63fe9f357"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "954ec8e66f686bad348f36fd404422fa"
server_key_iv: "a16d234bac2a74895fa030ef7751565b"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.202672 13953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:14.224228 13953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:14.225126 13953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:14.225473 13953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:14.226665 13953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:14.228231 13953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:14.228372 13953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.228490 13953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:14.228567 13953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.263742 13953 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.193:33491
I20260811 01:36:14.263842 14095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.193:33491 every 8 connection(s)
I20260811 01:36:14.265182 13953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/data/info.pb
I20260811 01:36:14.274768 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 13953
I20260811 01:36:14.275017 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-0/wal/instance
I20260811 01:36:14.275542 23711 external_mini_cluster.cc:1428] Setting key bf64e2cc454241871ea51cd76a6e08d0
I20260811 01:36:14.279138 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.194:0
--local_ip_for_outbound_sockets=127.23.39.194
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--builtin_ntp_servers=127.23.39.212:32863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:36:14.281315 14100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:14.268573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42619 (local address 127.23.39.193:52421)
0811 01:36:14.269553 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:14.269601 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:14.271578 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:14.272414 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:14.272423 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:14.272518 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:14.273215 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:14.273236 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.274668 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.274674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:14.276269 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:14.276284 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.277401 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.277412 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:14.277710 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:14.278674 (+ 964us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:14.278681 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:14.278751 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:14.278887 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:14.279452 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:14.279462 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:14.279469 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 01:36:14.279675 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 01:36:14.280101 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":301,"threads_started":1}
I20260811 01:36:14.282495 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:14.268083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.193:52421 (local address 127.23.39.254:42619)
0811 01:36:14.268678 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:14.268683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:14.269745 (+ 1062us) server_negotiation.cc:407] Connection header received
0811 01:36:14.271893 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:14.271901 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:14.272010 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:14.272144 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:14.273413 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.274416 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.276460 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.277030 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.277181 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:14.279147 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:14.279153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:14.279156 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:14.279185 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:14.279237 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:14.279250 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:14.279382 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:14.281934 (+ 2552us) server_negotiation.cc:299] Negotiation successful
0811 01:36:14.282056 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":445,"thread_start_us":317,"threads_started":1}
I20260811 01:36:14.283999 14096 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42619
I20260811 01:36:14.284390 14096 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:14.285488 14096 heartbeater.cc:511] Master 127.23.39.254:42619 requested a full tablet report, sending...
I20260811 01:36:14.288018 13889 ts_manager.cc:194] Registered new tserver with Master: 78603555e45443f5b0fcbee63fe9f357 (127.23.39.193:33491)
I20260811 01:36:14.289589 13889 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.193:52421
W20260811 01:36:14.636317 14101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:14.636605 14101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:14.636695 14101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:14.644060 14101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:14.644181 14101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:14.644289 14101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.194
I20260811 01:36:14.653729 14101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:32863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.39.194
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.194
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:14.655015 14101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:14.656802 14101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:14.671779 14107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:14.671855 14110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:14.671813 14106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:14.675746 14101 server_base.cc:1034] running on GCE node
I20260811 01:36:14.676443 14101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:14.677409 14101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:14.678637 14101 hybrid_clock.cc:648] HybridClock initialized: now 1786412174678584 us; error 50 us; skew 500 ppm
I20260811 01:36:14.679055 14101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:14.681937 14101 webserver.cc:460] Webserver started at http://127.23.39.194:46849/ using document root <none> and password file <none>
I20260811 01:36:14.682814 14101 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:14.682933 14101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:14.683328 14101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:14.687222 14101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data/instance:
uuid: "132800731714432895082ae46bf853bf"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "02379722f4c3485288571fc665ea581e"
server_key_iv: "9fe8f50b6f1d446f3f8ed0f7d7a109cc"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.688215 14101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance:
uuid: "132800731714432895082ae46bf853bf"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "02379722f4c3485288571fc665ea581e"
server_key_iv: "9fe8f50b6f1d446f3f8ed0f7d7a109cc"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.694761 14101 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:36:14.699257 14116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.700930 14101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:14.701123 14101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal
uuid: "132800731714432895082ae46bf853bf"
format_stamp: "Formatted at 2026-08-11 01:36:14 on dist-test-slave-9jjr"
server_key: "02379722f4c3485288571fc665ea581e"
server_key_iv: "9fe8f50b6f1d446f3f8ed0f7d7a109cc"
server_key_version: "encryptionkey@0"
I20260811 01:36:14.701336 14101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:14.724138 14101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:14.725028 14101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:14.725307 14101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:14.726377 14101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:14.727824 14101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:14.727911 14101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.727989 14101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:14.728044 14101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:14.762271 14101 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.194:34265
I20260811 01:36:14.762318 14243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.194:34265 every 8 connection(s)
I20260811 01:36:14.763623 14101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/data/info.pb
I20260811 01:36:14.766942 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14101
I20260811 01:36:14.767134 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal/instance
I20260811 01:36:14.767637 23711 external_mini_cluster.cc:1428] Setting key 281dbd08dee96278a27d35ec4fc07234
I20260811 01:36:14.770720 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.39.195:0
--local_ip_for_outbound_sockets=127.23.39.195
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--builtin_ntp_servers=127.23.39.212:32863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 01:36:14.777658 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:14.766389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.194:56785 (local address 127.23.39.254:42619)
0811 01:36:14.766623 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:14.766630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:14.768184 (+ 1554us) server_negotiation.cc:407] Connection header received
0811 01:36:14.770247 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:14.770252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:14.770342 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:14.770465 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:14.771549 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.772759 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.774427 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.775167 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.775351 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:14.776720 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:14.776729 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:14.776736 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:14.776764 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:14.776808 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:14.776828 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:14.776927 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:14.777131 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 01:36:14.777250 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 01:36:14.778594 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:14.766897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42619 (local address 127.23.39.194:56785)
0811 01:36:14.768002 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:14.768056 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:14.769950 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:14.770639 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:14.770647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:14.770756 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:14.771376 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:14.771392 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.772914 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.772917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:14.774283 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:14.774296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:14.775444 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:14.775450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:14.775658 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:14.776386 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:14.776389 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:14.776428 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:14.776511 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:14.776930 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:14.776938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:14.776943 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 01:36:14.777091 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 01:36:14.777404 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":370,"threads_started":1}
I20260811 01:36:14.780099 14244 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42619
I20260811 01:36:14.780442 14244 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:14.781399 14244 heartbeater.cc:511] Master 127.23.39.254:42619 requested a full tablet report, sending...
I20260811 01:36:14.783092 13889 ts_manager.cc:194] Registered new tserver with Master: 132800731714432895082ae46bf853bf (127.23.39.194:34265)
I20260811 01:36:14.783962 13889 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.194:56785
W20260811 01:36:15.128470 14247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:15.128788 14247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:15.128922 14247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:15.136277 14247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:15.136391 14247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:15.136499 14247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.39.195
I20260811 01:36:15.145691 14247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:32863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.39.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.39.195
--webserver_port=0
--tserver_master_addrs=127.23.39.254:42619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.39.195
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:15.147015 14247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:15.148757 14247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:15.162150 14257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:15.162042 14254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:15.162204 14252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:15.163040 14247 server_base.cc:1034] running on GCE node
I20260811 01:36:15.163658 14247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:15.164610 14247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:15.165819 14247 hybrid_clock.cc:648] HybridClock initialized: now 1786412175165750 us; error 62 us; skew 500 ppm
I20260811 01:36:15.166240 14247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 01:36:15.168711 14247 webserver.cc:460] Webserver started at http://127.23.39.195:41729/ using document root <none> and password file <none>
I20260811 01:36:15.169433 14247 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:15.169549 14247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:15.169881 14247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:15.172900 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data/instance:
uuid: "c5a8f3111fed43ac93fba40bcc6ae184"
format_stamp: "Formatted at 2026-08-11 01:36:15 on dist-test-slave-9jjr"
server_key: "7731667d25ad5b4acf890b7562b0d3b4"
server_key_iv: "1709cf93d56cbb345e72620230e9471e"
server_key_version: "encryptionkey@0"
I20260811 01:36:15.173723 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance:
uuid: "c5a8f3111fed43ac93fba40bcc6ae184"
format_stamp: "Formatted at 2026-08-11 01:36:15 on dist-test-slave-9jjr"
server_key: "7731667d25ad5b4acf890b7562b0d3b4"
server_key_iv: "1709cf93d56cbb345e72620230e9471e"
server_key_version: "encryptionkey@0"
I20260811 01:36:15.179313 14247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260811 01:36:15.182873 14263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:15.184226 14247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:15.184397 14247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal
uuid: "c5a8f3111fed43ac93fba40bcc6ae184"
format_stamp: "Formatted at 2026-08-11 01:36:15 on dist-test-slave-9jjr"
server_key: "7731667d25ad5b4acf890b7562b0d3b4"
server_key_iv: "1709cf93d56cbb345e72620230e9471e"
server_key_version: "encryptionkey@0"
I20260811 01:36:15.184618 14247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:15.200688 14247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:15.201534 14247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:15.201840 14247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:15.202922 14247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 01:36:15.204396 14247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 01:36:15.204516 14247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:15.204638 14247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 01:36:15.204728 14247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:15.239023 14247 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.195:34353
I20260811 01:36:15.239078 14394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.195:34353 every 8 connection(s)
I20260811 01:36:15.240454 14247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/data/info.pb
I20260811 01:36:15.247517 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14247
I20260811 01:36:15.247731 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal/instance
I20260811 01:36:15.248371 23711 external_mini_cluster.cc:1428] Setting key 5d1b4c570f877160e5a3215f489af99e
I20260811 01:36:15.253674 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.243113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:33739 (local address 127.23.39.254:42619)
0811 01:36:15.243342 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.243348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.244689 (+ 1341us) server_negotiation.cc:407] Connection header received
0811 01:36:15.246532 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.246536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.246606 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.246685 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:15.247788 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.248912 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.250817 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.251379 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.251521 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.252971 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:15.252976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:15.252979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:15.252997 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:15.253031 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:15.253043 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:15.253115 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.253345 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.253429 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:36:15.254750 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.243650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:42619 (local address 127.23.39.195:33739)
0811 01:36:15.244537 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.244575 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.246265 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.246899 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.246907 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.246991 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:15.247571 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.247587 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.249119 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.249126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.250674 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.250687 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.251671 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.251677 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.251887 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.252644 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 01:36:15.252647 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:15.252705 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 01:36:15.252788 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:15.253128 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:15.253136 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:15.253142 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.253322 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.253620 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":282,"threads_started":1}
I20260811 01:36:15.256088 14395 heartbeater.cc:347] Connected to a master server at 127.23.39.254:42619
I20260811 01:36:15.256398 14395 heartbeater.cc:464] Registering TS with master...
I20260811 01:36:15.257180 14395 heartbeater.cc:511] Master 127.23.39.254:42619 requested a full tablet report, sending...
I20260811 01:36:15.258646 13889 ts_manager.cc:194] Registered new tserver with Master: c5a8f3111fed43ac93fba40bcc6ae184 (127.23.39.195:34353)
I20260811 01:36:15.259469 13889 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.39.195:33739
I20260811 01:36:15.264051 23711 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 01:36:15.274266 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.268631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60134 (local address 127.23.39.254:42619)
0811 01:36:15.268817 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.268821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.269249 (+ 428us) server_negotiation.cc:407] Connection header received
0811 01:36:15.269394 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.269397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.269459 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.269544 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:15.270025 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.270795 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.272126 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.272552 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.272649 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.273586 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:15.273590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:15.273594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:15.273612 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:15.273643 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:15.273655 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:15.273729 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.273853 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.273930 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 01:36:15.278070 13889 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 01:36:15.285187 13889 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 01:36:15.293918 14096 heartbeater.cc:503] Master 127.23.39.254:42619 was elected leader, sending a full tablet report...
I20260811 01:36:15.323261 14408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.298418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40456)
0811 01:36:15.299609 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.299654 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.299842 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.312644 (+ 12802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.312657 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.312714 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:15.313312 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.313330 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.317643 (+ 4313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.317649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.319567 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.319593 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.322493 (+ 2900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.322502 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.322681 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.322723 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.322824 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.322982 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":1627,"threads_started":1}
I20260811 01:36:15.325026 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.299279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40456 (local address 127.23.39.193:33491)
0811 01:36:15.311378 (+ 12099us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.311392 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.311444 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:36:15.311608 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.311620 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.311979 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.313677 (+ 1698us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:15.313991 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.316006 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.319838 (+ 3832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.322007 (+ 2169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.323866 (+ 1859us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.324205 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.324312 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.324494 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11811,"thread_start_us":12929,"threads_started":1}
I20260811 01:36:15.327422 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.299517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34265 (local address 127.0.0.1:47070)
0811 01:36:15.312197 (+ 12680us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.312231 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.312445 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.316783 (+ 4338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.316793 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.316841 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:15.317449 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.317475 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.321226 (+ 3751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.321232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.323667 (+ 2435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.323685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.326455 (+ 2770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.326462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.326659 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.326746 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.326851 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.327007 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12419,"mutex_wait_us":37,"thread_start_us":17913,"threads_started":1}
I20260811 01:36:15.327414 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.300040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.23.39.194:34265)
0811 01:36:15.314815 (+ 14775us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.314829 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.314873 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:36:15.315010 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.315023 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.316423 (+ 1400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.317660 (+ 1237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:15.317993 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.320309 (+ 2316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.323914 (+ 3605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.326197 (+ 2283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.326347 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.326759 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.326899 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.327082 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14510,"thread_start_us":14380,"threads_started":1}
I20260811 01:36:15.329408 14023 tablet_service.cc:1467] Processing CreateTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb (DEFAULT_TABLE table=test-table [id=766b7967fbc64c54a166a7d5706c53e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:15.331200 14023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b96f81ae75f4bfe89bbec837bb82eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:15.331458 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.299716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.195:34353 (local address 127.0.0.1:41052)
0811 01:36:15.317939 (+ 18223us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.317960 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.318102 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.322271 (+ 4169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.322276 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.322316 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:15.322823 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.322837 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.324868 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.324873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.328071 (+ 3198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.328091 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.330106 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.330113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.330421 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.330458 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.330832 (+ 374us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.330987 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18063,"thread_start_us":12890,"threads_started":1}
I20260811 01:36:15.331513 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.299808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41052 (local address 127.23.39.195:34353)
0811 01:36:15.321232 (+ 21424us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.321243 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.321293 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:36:15.321421 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.321432 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.321760 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.322069 (+ 309us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:15.323331 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.324638 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.328320 (+ 3682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.329872 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.330033 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.330844 (+ 811us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.330942 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.331129 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21109,"thread_start_us":20906,"threads_started":1}
I20260811 01:36:15.331571 14168 tablet_service.cc:1467] Processing CreateTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb (DEFAULT_TABLE table=test-table [id=766b7967fbc64c54a166a7d5706c53e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:15.333173 14168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b96f81ae75f4bfe89bbec837bb82eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:15.335963 14318 tablet_service.cc:1467] Processing CreateTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb (DEFAULT_TABLE table=test-table [id=766b7967fbc64c54a166a7d5706c53e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 01:36:15.337949 14318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b96f81ae75f4bfe89bbec837bb82eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:15.344993 14414 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Bootstrap starting.
I20260811 01:36:15.347190 14415 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Bootstrap starting.
I20260811 01:36:15.349069 14414 tablet_bootstrap.cc:654] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:15.350652 14414 log.cc:824] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:15.351011 14415 tablet_bootstrap.cc:654] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:15.352505 14415 log.cc:824] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:15.355018 14414 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: No bootstrap required, opened a new log
I20260811 01:36:15.355350 14414 ts_tablet_manager.cc:1397] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260811 01:36:15.355782 14415 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: No bootstrap required, opened a new log
I20260811 01:36:15.356065 14415 ts_tablet_manager.cc:1397] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 01:36:15.358371 14418 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Bootstrap starting.
I20260811 01:36:15.361835 14418 tablet_bootstrap.cc:654] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:15.362972 14418 log.cc:824] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:15.365985 14418 tablet_bootstrap.cc:492] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: No bootstrap required, opened a new log
I20260811 01:36:15.366339 14418 ts_tablet_manager.cc:1397] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260811 01:36:15.366647 14414 raft_consensus.cc:348] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.367141 14414 raft_consensus.cc:374] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:15.367244 14414 raft_consensus.cc:729] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 132800731714432895082ae46bf853bf, State: Initialized, Role: FOLLOWER
I20260811 01:36:15.367064 14415 raft_consensus.cc:348] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.367524 14415 raft_consensus.cc:374] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:15.367650 14415 raft_consensus.cc:729] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78603555e45443f5b0fcbee63fe9f357, State: Initialized, Role: FOLLOWER
I20260811 01:36:15.368052 14414 consensus_queue.cc:260] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.368232 14415 consensus_queue.cc:260] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.369287 14244 heartbeater.cc:503] Master 127.23.39.254:42619 was elected leader, sending a full tablet report...
I20260811 01:36:15.370397 14414 ts_tablet_manager.cc:1428] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260811 01:36:15.375799 14415 ts_tablet_manager.cc:1428] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Time spent starting tablet: real 0.020s user 0.008s sys 0.012s
I20260811 01:36:15.377218 14418 raft_consensus.cc:348] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.377668 14418 raft_consensus.cc:374] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:15.377799 14418 raft_consensus.cc:729] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a8f3111fed43ac93fba40bcc6ae184, State: Initialized, Role: FOLLOWER
I20260811 01:36:15.378706 14418 consensus_queue.cc:260] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.379101 14424 raft_consensus.cc:482] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 01:36:15.379357 14424 raft_consensus.cc:504] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.380697 14395 heartbeater.cc:503] Master 127.23.39.254:42619 was elected leader, sending a full tablet report...
I20260811 01:36:15.381157 14418 ts_tablet_manager.cc:1428] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Time spent starting tablet: real 0.015s user 0.008s sys 0.004s
I20260811 01:36:15.381392 14424 leader_election.cc:288] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78603555e45443f5b0fcbee63fe9f357 (127.23.39.193:33491), 132800731714432895082ae46bf853bf (127.23.39.194:34265)
I20260811 01:36:15.389232 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.382417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:41219 (local address 127.23.39.193:33491)
0811 01:36:15.382687 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.382697 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.382722 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:36:15.382789 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.382794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.382881 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.382986 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:15.383385 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.384294 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.387058 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.388289 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.388411 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.388460 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.388843 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.388990 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:36:15.389328 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.382329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.39.195:50963 (local address 127.23.39.194:34265)
0811 01:36:15.382650 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.382656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.382676 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:36:15.382849 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.382854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.382948 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.383013 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 01:36:15.384011 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.385098 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.387523 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.388468 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.388630 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.388695 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.388961 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.389094 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260811 01:36:15.389320 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.381801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.23.39.195:41219)
0811 01:36:15.382012 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.382030 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.382201 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.383013 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.383017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.383042 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:15.383236 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.383246 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.384455 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.384461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.386881 (+ 2420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.386897 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.388437 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.388443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.388645 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.388703 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.388794 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.388960 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:36:15.389389 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.381838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.194:34265 (local address 127.23.39.195:50963)
0811 01:36:15.382562 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.382579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:15.382687 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:15.383249 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:15.383255 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:15.383293 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 01:36:15.383788 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.383804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.385323 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.385332 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.387357 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:15.387371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.388623 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.388628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:15.388814 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.388846 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 01:36:15.388935 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 01:36:15.389052 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":609,"threads_started":1}
I20260811 01:36:15.390501 14189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b96f81ae75f4bfe89bbec837bb82eeb" candidate_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "132800731714432895082ae46bf853bf" is_pre_election: true
I20260811 01:36:15.390646 14044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b96f81ae75f4bfe89bbec837bb82eeb" candidate_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78603555e45443f5b0fcbee63fe9f357" is_pre_election: true
I20260811 01:36:15.391037 14189 raft_consensus.cc:2454] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5a8f3111fed43ac93fba40bcc6ae184 in term 0.
I20260811 01:36:15.391161 14044 raft_consensus.cc:2454] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5a8f3111fed43ac93fba40bcc6ae184 in term 0.
I20260811 01:36:15.391676 14265 leader_election.cc:302] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 132800731714432895082ae46bf853bf, c5a8f3111fed43ac93fba40bcc6ae184; no voters:
I20260811 01:36:15.392024 14424 raft_consensus.cc:2781] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 01:36:15.392187 14424 raft_consensus.cc:482] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 01:36:15.392299 14424 raft_consensus.cc:3037] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:15.394652 14424 raft_consensus.cc:504] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.395256 14424 leader_election.cc:288] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [CANDIDATE]: Term 1 election: Requested vote from peers 78603555e45443f5b0fcbee63fe9f357 (127.23.39.193:33491), 132800731714432895082ae46bf853bf (127.23.39.194:34265)
I20260811 01:36:15.395721 14044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b96f81ae75f4bfe89bbec837bb82eeb" candidate_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78603555e45443f5b0fcbee63fe9f357"
I20260811 01:36:15.395720 14189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b96f81ae75f4bfe89bbec837bb82eeb" candidate_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "132800731714432895082ae46bf853bf"
I20260811 01:36:15.395944 14189 raft_consensus.cc:3037] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:15.395944 14044 raft_consensus.cc:3037] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:15.399466 14044 raft_consensus.cc:2454] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a8f3111fed43ac93fba40bcc6ae184 in term 1.
I20260811 01:36:15.399466 14189 raft_consensus.cc:2454] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5a8f3111fed43ac93fba40bcc6ae184 in term 1.
I20260811 01:36:15.399971 14267 leader_election.cc:302] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78603555e45443f5b0fcbee63fe9f357, c5a8f3111fed43ac93fba40bcc6ae184; no voters:
I20260811 01:36:15.400367 14424 raft_consensus.cc:2781] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:15.400568 14424 raft_consensus.cc:686] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 1 LEADER]: Becoming Leader. State: Replica: c5a8f3111fed43ac93fba40bcc6ae184, State: Running, Role: LEADER
I20260811 01:36:15.401062 14424 consensus_queue.cc:237] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } }
I20260811 01:36:15.406351 13889 catalog_manager.cc:5495] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5a8f3111fed43ac93fba40bcc6ae184 (127.23.39.195). New cstate: current_term: 1 leader_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5a8f3111fed43ac93fba40bcc6ae184" member_type: VOTER last_known_addr { host: "127.23.39.195" port: 34353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 } health_report { overall_health: UNKNOWN } } }
I20260811 01:36:15.438545 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.431892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41062 (local address 127.23.39.195:34353)
0811 01:36:15.432078 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.432083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.432105 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:36:15.432369 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.432374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.432503 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.432651 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:15.433189 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.434374 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.436238 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.436664 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.436796 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.437321 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:15.437869 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:15.438009 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.438081 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.438237 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:36:15.447359 14189 raft_consensus.cc:1261] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 1 FOLLOWER]: Refusing update from remote peer c5a8f3111fed43ac93fba40bcc6ae184: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:15.447353 14044 raft_consensus.cc:1261] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 1 FOLLOWER]: Refusing update from remote peer c5a8f3111fed43ac93fba40bcc6ae184: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:15.448489 14425 consensus_queue.cc:1035] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "132800731714432895082ae46bf853bf" member_type: VOTER last_known_addr { host: "127.23.39.194" port: 34265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:15.448910 14424 consensus_queue.cc:1035] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78603555e45443f5b0fcbee63fe9f357" member_type: VOTER last_known_addr { host: "127.23.39.193" port: 33491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:15.476997 13889 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:15.477279 13889 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 01:36:15.480854 13889 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d140969516c64fe0b82e7321f2b66d68: Sending DeleteTablet for 3 replicas of tablet 7b96f81ae75f4bfe89bbec837bb82eeb
I20260811 01:36:15.482218 14023 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:15 UTC) from {username='slave'} at 127.0.0.1:40456
I20260811 01:36:15.482225 14318 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:15 UTC) from {username='slave'} at 127.0.0.1:41052
I20260811 01:36:15.482473 14168 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b96f81ae75f4bfe89bbec837bb82eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 01:36:15 UTC) from {username='slave'} at 127.0.0.1:47070
I20260811 01:36:15.484558 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13953
I20260811 01:36:15.494926 14445 tablet_replica.cc:330] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: stopping tablet replica
I20260811 01:36:15.495663 14445 raft_consensus.cc:2229] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 1 LEADER]: Raft consensus shutting down.
I20260811 01:36:15.496634 14445 raft_consensus.cc:2258] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:15.500033 14445 ts_tablet_manager.cc:1905] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:15.510325 14445 ts_tablet_manager.cc:1918] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:15.510665 14445 log.cc:1196] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-2/wal/wals/7b96f81ae75f4bfe89bbec837bb82eeb
I20260811 01:36:15.511436 14445 ts_tablet_manager.cc:1939] T 7b96f81ae75f4bfe89bbec837bb82eeb P c5a8f3111fed43ac93fba40bcc6ae184: Deleting consensus metadata
I20260811 01:36:15.513607 13872 catalog_manager.cc:4841] TS c5a8f3111fed43ac93fba40bcc6ae184 (127.23.39.195:34353): tablet 7b96f81ae75f4bfe89bbec837bb82eeb (table test-table [id=766b7967fbc64c54a166a7d5706c53e8]) successfully deleted
I20260811 01:36:15.521713 14443 tablet_replica.cc:330] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: stopping tablet replica
I20260811 01:36:15.521793 14446 tablet_replica.cc:330] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: stopping tablet replica
I20260811 01:36:15.522257 14446 raft_consensus.cc:2229] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:15.522310 14443 raft_consensus.cc:2229] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 01:36:15.522833 14446 raft_consensus.cc:2258] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:15.522899 14443 raft_consensus.cc:2258] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 01:36:15.524482 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.486440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40468 (local address 127.23.39.193:33491)
0811 01:36:15.486631 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.486640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.511545 (+ 24905us) server_negotiation.cc:407] Connection header received
0811 01:36:15.512105 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.512114 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.512309 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.512407 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:15.513114 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.514342 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.516924 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.517924 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.518058 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.522465 (+ 4407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:15.522478 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:15.522497 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:15.523376 (+ 879us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:15.523448 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:15.523476 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:15.523609 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.523895 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.524045 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:36:15.525542 14446 ts_tablet_manager.cc:1905] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:15.525548 14443 ts_tablet_manager.cc:1905] T 7b96f81ae75f4bfe89bbec837bb82eeb P 78603555e45443f5b0fcbee63fe9f357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 01:36:15.525766 14091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:15.533476 14446 ts_tablet_manager.cc:1918] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 01:36:15.533663 14446 log.cc:1196] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Deleting WAL directory at /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786411836859029-23711-0/minicluster-data/ts-1/wal/wals/7b96f81ae75f4bfe89bbec837bb82eeb
I20260811 01:36:15.534283 14446 ts_tablet_manager.cc:1939] T 7b96f81ae75f4bfe89bbec837bb82eeb P 132800731714432895082ae46bf853bf: Deleting consensus metadata
I20260811 01:36:15.536383 13873 catalog_manager.cc:4841] TS 132800731714432895082ae46bf853bf (127.23.39.194:34265): tablet 7b96f81ae75f4bfe89bbec837bb82eeb (table test-table [id=766b7967fbc64c54a166a7d5706c53e8]) successfully deleted
I20260811 01:36:15.620846 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13953
I20260811 01:36:15.644038 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14101
W20260811 01:36:15.644085 13874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.39.193:33491 (error 108)
I20260811 01:36:15.646320 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.645736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40484)
0811 01:36:15.645940 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.646074 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 01:36:15.646718 13874 catalog_manager.cc:4584] TS 78603555e45443f5b0fcbee63fe9f357 (127.23.39.193:33491): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b96f81ae75f4bfe89bbec837bb82eeb: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
I20260811 01:36:15.653926 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.645202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.23.39.194:34265)
0811 01:36:15.645416 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.645422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.646183 (+ 761us) server_negotiation.cc:407] Connection header received
0811 01:36:15.646394 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.646401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.646517 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.646627 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:15.647167 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.648386 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.650373 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.651040 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.651177 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.652287 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:15.652300 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:15.652319 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:15.653125 (+ 806us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:15.653191 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:15.653218 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:15.653342 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.653441 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.653557 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 01:36:15.654778 14239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:15.700517 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.699921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40500)
0811 01:36:15.700210 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.700309 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260811 01:36:15.701721 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.701308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40514)
0811 01:36:15.701497 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.701575 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:36:15.752164 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14101
I20260811 01:36:15.762846 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.762156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40528)
0811 01:36:15.762453 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.762578 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 01:36:15.764189 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.763728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40530)
0811 01:36:15.763917 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.764016 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 01:36:15.774632 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14247
I20260811 01:36:15.782061 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.775532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41070 (local address 127.23.39.195:34353)
0811 01:36:15.775789 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:15.775795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:15.775817 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:36:15.775948 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:15.775953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:15.776033 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:15.776163 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:15.776597 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.777500 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.778874 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:15.779311 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:15.779450 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:15.780598 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:15.780607 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:15.780622 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:15.781270 (+ 648us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:15.781318 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:15.781337 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:15.781465 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:15.781606 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:36:15.781723 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 01:36:15.782944 14390 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:15.844996 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.844497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40532)
0811 01:36:15.844737 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.844831 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:36:15.846186 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:15.845747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40544)
0811 01:36:15.845959 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:15.846030 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:36:15.908527 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14247
I20260811 01:36:15.933689 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 13852
I20260811 01:36:15.934866 13922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:16.047044 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:16.046437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.193:33491 (local address 127.0.0.1:40556)
0811 01:36:16.046732 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:16.046866 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.193:33491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:36:16.047350 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 13852
2026-08-11T01:36:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2927 ms)
[----------] 6 tests from EncryptionPolicyTest (23467 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:16 dist-test-slave-9jjr krb5kdc[14455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:16 dist-test-slave-9jjr krb5kdc[14455](info): set up 2 sockets
Aug 11 01:36:16 dist-test-slave-9jjr krb5kdc[14455](info): commencing operation
krb5kdc: starting...
W20260811 01:36:17.292227 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.008s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:17 dist-test-slave-9jjr krb5kdc[14455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:17.646944 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:18.002676 14470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:18.002985 14470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:18.003177 14470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:18.010586 14470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:18.010707 14470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:18.010799 14470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:18.010910 14470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:18.010983 14470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:18.021169 14470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41673
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:18.022663 14470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:18.024129 14470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:18.036439 14475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:18.036340 14476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:18.036418 14478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:18.037635 14470 server_base.cc:1034] running on GCE node
I20260811 01:36:18.038594 14470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:18.040143 14470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:18.041353 14470 hybrid_clock.cc:648] HybridClock initialized: now 1786412178041290 us; error 57 us; skew 500 ppm
I20260811 01:36:18.041678 14470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:18 dist-test-slave-9jjr krb5kdc[14455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412178, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:18.048511 14470 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:18.050328 14470 webserver.cc:460] Webserver started at http://127.0.0.1:41623/ using document root <none> and password file <none>
I20260811 01:36:18.051040 14470 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:18.051146 14470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:18.051424 14470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:18.054605 14470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "404ae28324744eae8cfdba2ebb8e7dc4"
format_stamp: "Formatted at 2026-08-11 01:36:18 on dist-test-slave-9jjr"
server_key: "e8e9e2190762e3013684d913d3e1ddbd"
server_key_iv: "e3931c36c0f7b5c5adf3d2b79a41c329"
server_key_version: "encryptionkey@0"
I20260811 01:36:18.055383 14470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "404ae28324744eae8cfdba2ebb8e7dc4"
format_stamp: "Formatted at 2026-08-11 01:36:18 on dist-test-slave-9jjr"
server_key: "e8e9e2190762e3013684d913d3e1ddbd"
server_key_iv: "e3931c36c0f7b5c5adf3d2b79a41c329"
server_key_version: "encryptionkey@0"
I20260811 01:36:18.061149 14470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:36:18.064832 14485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:18.066319 14470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:18.066476 14470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "404ae28324744eae8cfdba2ebb8e7dc4"
format_stamp: "Formatted at 2026-08-11 01:36:18 on dist-test-slave-9jjr"
server_key: "e8e9e2190762e3013684d913d3e1ddbd"
server_key_iv: "e3931c36c0f7b5c5adf3d2b79a41c329"
server_key_version: "encryptionkey@0"
I20260811 01:36:18.066648 14470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:18.101886 14470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:18.106482 14470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:18.106727 14470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:18.126459 14470 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41673
I20260811 01:36:18.126503 14546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41673 every 8 connection(s)
I20260811 01:36:18.127938 14470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:18.131954 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:18.132838 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14470
I20260811 01:36:18.133095 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:18.134002 23711 external_mini_cluster.cc:1428] Setting key c2c3c8332d48c92b1caef339f9cbf797
I20260811 01:36:18.146948 14547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4: Bootstrap starting.
Aug 11 01:36:18 dist-test-slave-9jjr krb5kdc[14455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:36:18.150906 14547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:18.152089 14547 log.cc:824] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:18.155650 14547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4: No bootstrap required, opened a new log
I20260811 01:36:18.159938 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:18.136130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46221 (local address 127.0.0.1:41673)
0811 01:36:18.136980 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:18.136995 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:18.137040 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:36:18.138794 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:18.138817 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:18.139232 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:18.139580 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:18.141476 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:18.142910 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:18.144818 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:18.145498 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:18.145632 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:18.150771 (+ 5139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:18.150780 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:18.150795 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:18.150845 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:18.154755 (+ 3910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:18.155697 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:18.155708 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:18.155719 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:18.155958 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:18.156474 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:18.156479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:18.156482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:18.157289 (+ 807us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:18.157629 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:18.158038 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 01:36:18.158462 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":375,"threads_started":1}
I20260811 01:36:18.164443 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:18.165840 14547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260811 01:36:18.166304 14547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:18.166419 14547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404ae28324744eae8cfdba2ebb8e7dc4, State: Initialized, Role: FOLLOWER
I20260811 01:36:18.166975 14547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260811 01:36:18.167229 14547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:18.167378 14547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:18.167548 14547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:18.170267 14547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260811 01:36:18.170920 14547 leader_election.cc:302] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 404ae28324744eae8cfdba2ebb8e7dc4; no voters:
I20260811 01:36:18.171624 14547 leader_election.cc:288] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:18.171725 14558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:18.172912 14558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [term 1 LEADER]: Becoming Leader. State: Replica: 404ae28324744eae8cfdba2ebb8e7dc4, State: Running, Role: LEADER
I20260811 01:36:18.173593 14558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } }
I20260811 01:36:18.174234 14547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:18.176823 14559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } } }
I20260811 01:36:18.177304 14559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:18.177873 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 404ae28324744eae8cfdba2ebb8e7dc4. Latest consensus state: current_term: 1 leader_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404ae28324744eae8cfdba2ebb8e7dc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41673 } } }
I20260811 01:36:18.178282 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:18.187136 14563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:18.188910 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:18.169659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44215 (local address 127.0.0.1:41673)
0811 01:36:18.169849 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:18.169856 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:18.170373 (+ 517us) server_negotiation.cc:407] Connection header received
0811 01:36:18.170625 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:18.170631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:18.170743 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:18.170859 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:18.172642 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:18.173678 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:18.175115 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:18.175861 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:18.175983 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:18.179661 (+ 3678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:18.179671 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:18.179677 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:18.179730 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:18.184670 (+ 4940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:18.185906 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:18.185916 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:18.185922 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:18.186099 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:18.186892 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:18.186897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:18.186901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:18.187375 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:18.187626 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:18.188325 (+ 699us) server_negotiation.cc:299] Negotiation successful
0811 01:36:18.188519 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:36:18.193260 14563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:18.204268 14563 catalog_manager.cc:1347] Generated new cluster ID: bfc9694a90b9493695ba06e6cfb26468
I20260811 01:36:18.204398 14563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:18.224124 14563 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:18.225591 14563 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:18.234735 14563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 404ae28324744eae8cfdba2ebb8e7dc4: Generated new TSK 0
I20260811 01:36:18.235598 14563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:18.243223 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14470
I20260811 01:36:18.244647 14542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:18.339000 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14470
W20260811 01:36:18.361591 14453 connection.cc:535] client connection to 127.0.0.1:41673 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41673): Connection reset by peer (error 104)
2026-08-11T01:36:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2286 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:18 dist-test-slave-9jjr krb5kdc[14584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:18 dist-test-slave-9jjr krb5kdc[14584](info): set up 2 sockets
Aug 11 01:36:18 dist-test-slave-9jjr krb5kdc[14584](info): commencing operation
krb5kdc: starting...
W20260811 01:36:19.547652 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:19 dist-test-slave-9jjr krb5kdc[14584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:19.902742 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34657
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:20.255995 14599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:20.256330 14599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:20.256513 14599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:20.264042 14599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:20.264178 14599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:20.264268 14599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:20.264380 14599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:20.264463 14599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:20.274724 14599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34657
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:20.276230 14599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:20.277549 14599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:20.289598 14607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:20.289541 14604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:20.289568 14605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:20.290251 14599 server_base.cc:1034] running on GCE node
I20260811 01:36:20.291159 14599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:20.292620 14599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:20.293845 14599 hybrid_clock.cc:648] HybridClock initialized: now 1786412180293793 us; error 49 us; skew 500 ppm
I20260811 01:36:20.294236 14599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:20 dist-test-slave-9jjr krb5kdc[14584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412180, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:20.297461 14599 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:20.298962 14599 webserver.cc:460] Webserver started at http://127.0.0.1:45519/ using document root <none> and password file <none>
I20260811 01:36:20.299597 14599 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:20.299700 14599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:20.299965 14599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:20.303028 14599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "bae3818e3dba4841bb2832c22363dc9a"
format_stamp: "Formatted at 2026-08-11 01:36:20 on dist-test-slave-9jjr"
server_key: "7f8be1ef0fd31d9a3cc02df6af128a08"
server_key_iv: "4c17439d27a93202ddb43db4bc47bdbe"
server_key_version: "encryptionkey@0"
I20260811 01:36:20.303785 14599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "bae3818e3dba4841bb2832c22363dc9a"
format_stamp: "Formatted at 2026-08-11 01:36:20 on dist-test-slave-9jjr"
server_key: "7f8be1ef0fd31d9a3cc02df6af128a08"
server_key_iv: "4c17439d27a93202ddb43db4bc47bdbe"
server_key_version: "encryptionkey@0"
I20260811 01:36:20.308981 14599 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:36:20.312448 14614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:20.313760 14599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 01:36:20.313937 14599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "bae3818e3dba4841bb2832c22363dc9a"
format_stamp: "Formatted at 2026-08-11 01:36:20 on dist-test-slave-9jjr"
server_key: "7f8be1ef0fd31d9a3cc02df6af128a08"
server_key_iv: "4c17439d27a93202ddb43db4bc47bdbe"
server_key_version: "encryptionkey@0"
I20260811 01:36:20.314128 14599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:20.333335 14599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:20.337920 14599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:20.338192 14599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:20.357373 14599 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34657
I20260811 01:36:20.357427 14670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34657 every 8 connection(s)
I20260811 01:36:20.358785 14599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:20.362895 14672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:20.367383 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14599
I20260811 01:36:20.367579 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:20.368022 23711 external_mini_cluster.cc:1428] Setting key 55a1cbc525f937b016ea07dc8538a022
I20260811 01:36:20.374323 14672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a: Bootstrap starting.
I20260811 01:36:20.378192 14672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:20.379515 14672 log.cc:824] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:20.382849 14672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a: No bootstrap required, opened a new log
I20260811 01:36:20.382894 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:20.370150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54837 (local address 127.0.0.1:34657)
0811 01:36:20.371189 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:20.371202 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:20.371247 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:36:20.373020 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:20.373042 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:20.373449 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:20.373777 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:20.374535 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:20.375903 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:20.377800 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:20.378657 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:20.378799 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:20.380309 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:20.380323 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:20.380346 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:20.381141 (+ 795us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:20.381212 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:20.381240 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:20.381363 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:20.381647 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 01:36:20.381847 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":515,"threads_started":1}
I20260811 01:36:20.386823 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:20.391515 14672 raft_consensus.cc:348] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } }
I20260811 01:36:20.392086 14672 raft_consensus.cc:374] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:20.392226 14672 raft_consensus.cc:729] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae3818e3dba4841bb2832c22363dc9a, State: Initialized, Role: FOLLOWER
I20260811 01:36:20.392958 14672 consensus_queue.cc:260] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } }
I20260811 01:36:20.393268 14672 raft_consensus.cc:388] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:20.393437 14672 raft_consensus.cc:482] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:20.393630 14672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:20.396873 14672 raft_consensus.cc:504] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } }
I20260811 01:36:20.397538 14672 leader_election.cc:302] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bae3818e3dba4841bb2832c22363dc9a; no voters:
I20260811 01:36:20.398320 14672 leader_election.cc:288] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:20.398478 14683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:20.398833 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:20.391416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36111 (local address 127.0.0.1:34657)
0811 01:36:20.391602 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:20.391610 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:20.392017 (+ 407us) server_negotiation.cc:407] Connection header received
0811 01:36:20.392237 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:20.392242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:20.392304 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:20.392409 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:20.392994 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:20.393929 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:20.395956 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:20.396395 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:20.396488 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:20.397802 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:20.397807 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:20.397810 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:20.397828 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:20.397866 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:20.397881 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:20.397966 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:20.398297 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 01:36:20.398358 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 01:36:20.401093 14672 sys_catalog.cc:564] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:20.405977 14683 raft_consensus.cc:686] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [term 1 LEADER]: Becoming Leader. State: Replica: bae3818e3dba4841bb2832c22363dc9a, State: Running, Role: LEADER
I20260811 01:36:20.406562 14683 consensus_queue.cc:237] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } }
I20260811 01:36:20.409698 14684 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bae3818e3dba4841bb2832c22363dc9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } } }
I20260811 01:36:20.410090 14684 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:20.411479 14685 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bae3818e3dba4841bb2832c22363dc9a. Latest consensus state: current_term: 1 leader_uuid: "bae3818e3dba4841bb2832c22363dc9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae3818e3dba4841bb2832c22363dc9a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34657 } } }
I20260811 01:36:20.411854 14685 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:20.412487 14694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:20.417804 14694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:20.426755 14694 catalog_manager.cc:1347] Generated new cluster ID: 370a5b862aae416588c1fd2f0c511dab
I20260811 01:36:20.426942 14694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:20.466197 14694 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:20.468102 14694 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:20.487309 14694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bae3818e3dba4841bb2832c22363dc9a: Generated new TSK 0
I20260811 01:36:20.488489 14694 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:20.506783 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14599
W20260811 01:36:20.508041 14666 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54837
W20260811 01:36:20.508942 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14599: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:20.509174 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14599
W20260811 01:36:20.530880 14582 connection.cc:535] client connection to 127.0.0.1:34657 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34657): Connection reset by peer (error 104)
2026-08-11T01:36:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2169 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:20 dist-test-slave-9jjr krb5kdc[14705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:20 dist-test-slave-9jjr krb5kdc[14705](info): set up 2 sockets
Aug 11 01:36:20 dist-test-slave-9jjr krb5kdc[14705](info): commencing operation
krb5kdc: starting...
W20260811 01:36:21.731268 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.004s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:21 dist-test-slave-9jjr krb5kdc[14705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:22.085605 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42209
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:22.440129 14719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:22.440455 14719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:22.440618 14719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:22.448248 14719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:22.448400 14719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:22.448509 14719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:22.448603 14719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:22.448671 14719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:22.459069 14719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42209
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:22.460570 14719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:22.461942 14719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:22.474166 14724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:22.474121 14727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:22.474232 14725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:22.475245 14719 server_base.cc:1034] running on GCE node
I20260811 01:36:22.476096 14719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:22.477586 14719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:22.478820 14719 hybrid_clock.cc:648] HybridClock initialized: now 1786412182478776 us; error 68 us; skew 500 ppm
I20260811 01:36:22.479202 14719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:22 dist-test-slave-9jjr krb5kdc[14705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412182, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:22.482383 14719 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:22.483963 14719 webserver.cc:460] Webserver started at http://127.0.0.1:42917/ using document root <none> and password file <none>
I20260811 01:36:22.484690 14719 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:22.484838 14719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:22.485162 14719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:22.488302 14719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "607f59a3d3864ea8aef480e9e0238444"
format_stamp: "Formatted at 2026-08-11 01:36:22 on dist-test-slave-9jjr"
server_key: "668f9935e975fc9f467f5d3573f6e996"
server_key_iv: "25e74e1d43a480451c0a823eb66020b6"
server_key_version: "encryptionkey@0"
I20260811 01:36:22.489102 14719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "607f59a3d3864ea8aef480e9e0238444"
format_stamp: "Formatted at 2026-08-11 01:36:22 on dist-test-slave-9jjr"
server_key: "668f9935e975fc9f467f5d3573f6e996"
server_key_iv: "25e74e1d43a480451c0a823eb66020b6"
server_key_version: "encryptionkey@0"
I20260811 01:36:22.494570 14719 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:36:22.498245 14736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:22.499665 14719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:22.499879 14719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "607f59a3d3864ea8aef480e9e0238444"
format_stamp: "Formatted at 2026-08-11 01:36:22 on dist-test-slave-9jjr"
server_key: "668f9935e975fc9f467f5d3573f6e996"
server_key_iv: "25e74e1d43a480451c0a823eb66020b6"
server_key_version: "encryptionkey@0"
I20260811 01:36:22.500103 14719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:22.505875 14719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:22.510108 14719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:22.510486 14719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:22.529495 14719 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42209
I20260811 01:36:22.529536 14790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42209 every 8 connection(s)
I20260811 01:36:22.531183 14719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:22.535151 14791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:22.540402 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14719
I20260811 01:36:22.540628 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:22.541180 23711 external_mini_cluster.cc:1428] Setting key 4ca5b31fc35fd6b56c55771f59dcc3bc
I20260811 01:36:22.547196 14791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444: Bootstrap starting.
I20260811 01:36:22.549705 14795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:22.543047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39731 (local address 127.0.0.1:42209)
0811 01:36:22.543940 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:22.543954 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:22.543995 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:36:22.545772 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:22.545794 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:22.546199 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:22.546539 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:22.547778 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:22.547792 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:22.547812 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:22.547893 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:22.547967 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:22.547993 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:22.548219 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:22.548438 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 01:36:22.548676 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":388,"threads_started":1}
I20260811 01:36:22.551131 14791 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:22.552312 14791 log.cc:824] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:22.553730 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:22.555299 14791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444: No bootstrap required, opened a new log
I20260811 01:36:22.561604 14795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:22.558716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55407 (local address 127.0.0.1:42209)
0811 01:36:22.558921 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:22.558928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:22.559534 (+ 606us) server_negotiation.cc:407] Connection header received
0811 01:36:22.559701 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:22.559705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:22.559765 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:22.559888 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:22.560873 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:22.560877 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:22.560880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:22.560896 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:22.560942 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:22.560956 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:22.561055 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:22.561209 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 01:36:22.561262 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:36:22.564842 14791 raft_consensus.cc:348] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } }
I20260811 01:36:22.565244 14791 raft_consensus.cc:374] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:22.565367 14791 raft_consensus.cc:729] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 607f59a3d3864ea8aef480e9e0238444, State: Initialized, Role: FOLLOWER
I20260811 01:36:22.565999 14791 consensus_queue.cc:260] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } }
I20260811 01:36:22.566296 14791 raft_consensus.cc:388] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:22.566452 14791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:22.566644 14791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:22.569205 14791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } }
I20260811 01:36:22.569732 14791 leader_election.cc:302] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 607f59a3d3864ea8aef480e9e0238444; no voters:
I20260811 01:36:22.570376 14791 leader_election.cc:288] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:22.570520 14803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:22.571224 14803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [term 1 LEADER]: Becoming Leader. State: Replica: 607f59a3d3864ea8aef480e9e0238444, State: Running, Role: LEADER
I20260811 01:36:22.571838 14803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } }
I20260811 01:36:22.572573 14791 sys_catalog.cc:564] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:22.574618 14804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "607f59a3d3864ea8aef480e9e0238444" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } } }
I20260811 01:36:22.579592 14804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:22.578634 14805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 607f59a3d3864ea8aef480e9e0238444. Latest consensus state: current_term: 1 leader_uuid: "607f59a3d3864ea8aef480e9e0238444" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607f59a3d3864ea8aef480e9e0238444" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42209 } } }
I20260811 01:36:22.580963 14805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:22.587704 14809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:22.593485 14809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:22.602494 14809 catalog_manager.cc:1347] Generated new cluster ID: 4f9c5e9dbd8a40d088ddff4821a30e82
I20260811 01:36:22.602651 14809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:22.611627 14809 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:22.612142 14809 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:22.624769 14809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 607f59a3d3864ea8aef480e9e0238444: Generated new TSK 0
I20260811 01:36:22.625838 14809 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:22.638477 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14719
W20260811 01:36:22.639648 14786 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39731
W20260811 01:36:22.640323 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14719: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:22.640482 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14719
2026-08-11T01:36:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2133 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:22 dist-test-slave-9jjr krb5kdc[14826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:22 dist-test-slave-9jjr krb5kdc[14826](info): set up 2 sockets
Aug 11 01:36:22 dist-test-slave-9jjr krb5kdc[14826](info): commencing operation
krb5kdc: starting...
W20260811 01:36:23.867197 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:24 dist-test-slave-9jjr krb5kdc[14826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:24.207312 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:24.565807 14841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:24.566188 14841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:24.566363 14841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:24.574239 14841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:24.574378 14841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:24.574481 14841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:24.574584 14841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:24.574671 14841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:24.585129 14841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:24.586695 14841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:24.588119 14841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:24.600792 14849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:24.600623 14847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:24.601013 14846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:24.602344 14841 server_base.cc:1034] running on GCE node
I20260811 01:36:24.603286 14841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:24.604844 14841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:24.606078 14841 hybrid_clock.cc:648] HybridClock initialized: now 1786412184606025 us; error 67 us; skew 500 ppm
I20260811 01:36:24.606467 14841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:24 dist-test-slave-9jjr krb5kdc[14826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412184, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:24.613227 14841 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:24.614800 14841 webserver.cc:460] Webserver started at http://127.0.0.1:35195/ using document root <none> and password file <none>
I20260811 01:36:24.615557 14841 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:24.615715 14841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:24.616017 14841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:24.619153 14841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "7c37e06c09114907a27cb258c8030505"
format_stamp: "Formatted at 2026-08-11 01:36:24 on dist-test-slave-9jjr"
server_key: "c46d0edfeeca946e2bc51ba3d553ce26"
server_key_iv: "b0764e0bddd3b97f93796e1252ba2b0c"
server_key_version: "encryptionkey@0"
I20260811 01:36:24.619956 14841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "7c37e06c09114907a27cb258c8030505"
format_stamp: "Formatted at 2026-08-11 01:36:24 on dist-test-slave-9jjr"
server_key: "c46d0edfeeca946e2bc51ba3d553ce26"
server_key_iv: "b0764e0bddd3b97f93796e1252ba2b0c"
server_key_version: "encryptionkey@0"
I20260811 01:36:24.625100 14841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:36:24.628662 14858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:24.630018 14841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:24.630298 14841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "7c37e06c09114907a27cb258c8030505"
format_stamp: "Formatted at 2026-08-11 01:36:24 on dist-test-slave-9jjr"
server_key: "c46d0edfeeca946e2bc51ba3d553ce26"
server_key_iv: "b0764e0bddd3b97f93796e1252ba2b0c"
server_key_version: "encryptionkey@0"
I20260811 01:36:24.630504 14841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:24.648490 14841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:24.653164 14841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:24.653475 14841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:24.677291 14841 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46469
I20260811 01:36:24.677335 14915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46469 every 8 connection(s)
I20260811 01:36:24.678791 14841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:24.680729 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14841
I20260811 01:36:24.680950 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:24.681407 23711 external_mini_cluster.cc:1428] Setting key ee4724f5c4e0be4401ef3189ff79e40c
I20260811 01:36:24.683099 14917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:24.696820 14917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505: Bootstrap starting.
Aug 11 01:36:24 dist-test-slave-9jjr krb5kdc[14826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:36:24.700440 14917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:24.701589 14917 log.cc:824] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:24.705137 14917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505: No bootstrap required, opened a new log
I20260811 01:36:24.706241 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:24.683351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53055 (local address 127.0.0.1:46469)
0811 01:36:24.684213 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:24.684229 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:24.684280 (+ 51us) server_negotiation.cc:407] Connection header received
0811 01:36:24.686426 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:24.686454 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:24.686983 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:24.687444 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:24.689003 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:24.691095 (+ 2092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:24.692358 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:24.693420 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:24.693605 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:24.698259 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:24.698269 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:24.698283 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:24.698324 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:24.701589 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:24.702659 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:24.702669 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:24.702678 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:24.702939 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:24.703493 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:24.703497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:24.703499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:24.704046 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:24.704264 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:24.704794 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 01:36:24.705166 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":334,"threads_started":1}
I20260811 01:36:24.710234 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:24.714227 14917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260811 01:36:24.714630 14917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:24.714757 14917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c37e06c09114907a27cb258c8030505, State: Initialized, Role: FOLLOWER
I20260811 01:36:24.715457 14917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260811 01:36:24.715715 14917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:24.715875 14917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:24.716112 14917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:24.719056 14917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260811 01:36:24.719631 14917 leader_election.cc:302] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c37e06c09114907a27cb258c8030505; no voters:
I20260811 01:36:24.720324 14917 leader_election.cc:288] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:24.720445 14927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:24.721745 14927 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [term 1 LEADER]: Becoming Leader. State: Replica: 7c37e06c09114907a27cb258c8030505, State: Running, Role: LEADER
I20260811 01:36:24.722461 14927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260811 01:36:24.722959 14917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:24.726219 14929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c37e06c09114907a27cb258c8030505. Latest consensus state: current_term: 1 leader_uuid: "7c37e06c09114907a27cb258c8030505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } } }
I20260811 01:36:24.726986 14929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:24.728209 14928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c37e06c09114907a27cb258c8030505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c37e06c09114907a27cb258c8030505" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } } }
I20260811 01:36:24.728612 14928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:24.729592 14935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:24.734602 14935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:24.736634 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:24.715131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55695 (local address 127.0.0.1:46469)
0811 01:36:24.715331 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:24.715337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:24.715956 (+ 619us) server_negotiation.cc:407] Connection header received
0811 01:36:24.716166 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:24.716171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:24.716265 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:24.716384 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:24.717773 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:24.718905 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:24.720277 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:24.721078 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:24.721217 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:24.724286 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:24.724292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:24.724297 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:24.724341 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:24.731118 (+ 6777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:24.732290 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:24.732299 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:24.732305 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:24.732577 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:24.733171 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:24.733179 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:24.733185 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:24.733706 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:24.735489 (+ 1783us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:24.735726 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 01:36:24.736052 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:36:24.746383 14935 catalog_manager.cc:1347] Generated new cluster ID: 8a889a32a806479bad8719658623895b
I20260811 01:36:24.746541 14935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:24.766707 14935 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:24.768050 14935 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:24.777451 14935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c37e06c09114907a27cb258c8030505: Generated new TSK 0
I20260811 01:36:24.778374 14935 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:24.786731 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14841
I20260811 01:36:24.788117 14911 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:24.882025 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14841
2026-08-11T01:36:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2236 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:25 dist-test-slave-9jjr krb5kdc[14951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:25 dist-test-slave-9jjr krb5kdc[14951](info): set up 2 sockets
Aug 11 01:36:25 dist-test-slave-9jjr krb5kdc[14951](info): commencing operation
krb5kdc: starting...
W20260811 01:36:26.110857 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:26 dist-test-slave-9jjr krb5kdc[14951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:26.462771 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:26.820892 14964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:26.821293 14964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:26.821463 14964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:26.829486 14964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:26.829634 14964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:26.829720 14964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:26.829815 14964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:26.829900 14964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:26.840296 14964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:26.841674 14964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:26.843055 14964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:26.855191 14972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:26.855407 14970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:26.855914 14969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:26.856184 14964 server_base.cc:1034] running on GCE node
I20260811 01:36:26.857002 14964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:26.858489 14964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:26.859720 14964 hybrid_clock.cc:648] HybridClock initialized: now 1786412186859669 us; error 37 us; skew 500 ppm
I20260811 01:36:26.860150 14964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:26 dist-test-slave-9jjr krb5kdc[14951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412186, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:26.863654 14964 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:26.865243 14964 webserver.cc:460] Webserver started at http://127.0.0.1:33275/ using document root <none> and password file <none>
I20260811 01:36:26.865960 14964 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:26.866119 14964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:26.866493 14964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:26.869581 14964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "4fb8fa84cb4245578665562849029a50"
format_stamp: "Formatted at 2026-08-11 01:36:26 on dist-test-slave-9jjr"
server_key: "fca8086272a13970c1d005608627b7e0"
server_key_iv: "069c07aaeb0264f7aa5b8026a45eb91f"
server_key_version: "encryptionkey@0"
I20260811 01:36:26.870468 14964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "4fb8fa84cb4245578665562849029a50"
format_stamp: "Formatted at 2026-08-11 01:36:26 on dist-test-slave-9jjr"
server_key: "fca8086272a13970c1d005608627b7e0"
server_key_iv: "069c07aaeb0264f7aa5b8026a45eb91f"
server_key_version: "encryptionkey@0"
I20260811 01:36:26.875882 14964 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:26.879575 14979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:26.881131 14964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:26.881347 14964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "4fb8fa84cb4245578665562849029a50"
format_stamp: "Formatted at 2026-08-11 01:36:26 on dist-test-slave-9jjr"
server_key: "fca8086272a13970c1d005608627b7e0"
server_key_iv: "069c07aaeb0264f7aa5b8026a45eb91f"
server_key_version: "encryptionkey@0"
I20260811 01:36:26.881583 14964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:26.906252 14964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:26.911527 14964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:26.911881 14964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:26.933300 14964 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40785
I20260811 01:36:26.933336 15040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40785 every 8 connection(s)
I20260811 01:36:26.934928 14964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:26.937215 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 14964
I20260811 01:36:26.937430 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:26.937950 23711 external_mini_cluster.cc:1428] Setting key d6822248588b135aebfa2f4aac0d9dca
I20260811 01:36:26.939390 15041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:26.952358 15044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:26.939935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42619 (local address 127.0.0.1:40785)
0811 01:36:26.940833 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:26.940845 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:26.940888 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:36:26.942740 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:26.942763 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:26.943214 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:26.943579 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:26.944277 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:26.945696 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:26.947677 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:26.948352 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:26.948484 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:26.949879 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:26.949887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:26.949900 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:26.950578 (+ 678us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:26.950657 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:26.950690 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:26.950788 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:26.951040 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 01:36:26.951378 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":430,"threads_started":1}
I20260811 01:36:26.953687 15041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50: Bootstrap starting.
I20260811 01:36:26.956514 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:26.957273 15041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:26.958585 15041 log.cc:824] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:26.961715 15041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50: No bootstrap required, opened a new log
I20260811 01:36:26.968557 15044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:26.962063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54063 (local address 127.0.0.1:40785)
0811 01:36:26.962367 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:26.962374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:26.962743 (+ 369us) server_negotiation.cc:407] Connection header received
0811 01:36:26.962993 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:26.962997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:26.963075 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:26.963191 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:26.963719 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:26.964505 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:26.965863 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:26.966434 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:26.966600 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:26.967803 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:26.967809 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:26.967812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:26.967829 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:26.967865 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:26.967880 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:26.967992 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:26.968135 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 01:36:26.968233 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:36:26.970290 15041 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } }
I20260811 01:36:26.970721 15041 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:26.970831 15041 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fb8fa84cb4245578665562849029a50, State: Initialized, Role: FOLLOWER
I20260811 01:36:26.971442 15041 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } }
I20260811 01:36:26.971706 15041 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:26.971855 15041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:26.972036 15041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:26.974704 15041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } }
I20260811 01:36:26.975204 15041 leader_election.cc:302] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fb8fa84cb4245578665562849029a50; no voters:
I20260811 01:36:26.975797 15041 leader_election.cc:288] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:26.975926 15051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:26.976629 15051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [term 1 LEADER]: Becoming Leader. State: Replica: 4fb8fa84cb4245578665562849029a50, State: Running, Role: LEADER
I20260811 01:36:26.977218 15051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } }
I20260811 01:36:26.977994 15041 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:26.980075 15053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fb8fa84cb4245578665562849029a50. Latest consensus state: current_term: 1 leader_uuid: "4fb8fa84cb4245578665562849029a50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } } }
I20260811 01:36:26.980298 15052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fb8fa84cb4245578665562849029a50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fb8fa84cb4245578665562849029a50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40785 } } }
I20260811 01:36:26.980491 15053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:26.980553 15052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:26.983984 15056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:26.989741 15056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:26.999450 15056 catalog_manager.cc:1347] Generated new cluster ID: fbf13c83d5774932ad853bf736505d9f
I20260811 01:36:26.999583 15056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:27.014487 15056 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:27.015880 15056 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:27.023197 15056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fb8fa84cb4245578665562849029a50: Generated new TSK 0
I20260811 01:36:27.024085 15056 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:27.042407 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14964
W20260811 01:36:27.043562 15034 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42619
W20260811 01:36:27.044375 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 14964: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:27.044503 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 14964
2026-08-11T01:36:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2164 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:27 dist-test-slave-9jjr krb5kdc[15073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:27 dist-test-slave-9jjr krb5kdc[15073](info): set up 2 sockets
Aug 11 01:36:27 dist-test-slave-9jjr krb5kdc[15073](info): commencing operation
krb5kdc: starting...
W20260811 01:36:28.242372 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:28 dist-test-slave-9jjr krb5kdc[15073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:28.605408 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:28.972626 15087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:28.972934 15087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:28.973102 15087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:28.980530 15087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:28.980666 15087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:28.980753 15087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:28.980852 15087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:28.980963 15087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:28.991559 15087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:28.992942 15087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:28.994292 15087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:29.006940 15092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:29.006891 15093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:29.006908 15095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:29.007834 15087 server_base.cc:1034] running on GCE node
I20260811 01:36:29.008752 15087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:29.010392 15087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:29.011646 15087 hybrid_clock.cc:648] HybridClock initialized: now 1786412189011601 us; error 39 us; skew 500 ppm
I20260811 01:36:29.012120 15087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:29 dist-test-slave-9jjr krb5kdc[15073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:29.015488 15087 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:29.017040 15087 webserver.cc:460] Webserver started at http://127.0.0.1:36897/ using document root <none> and password file <none>
I20260811 01:36:29.017686 15087 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:29.017794 15087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:29.018046 15087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:29.021135 15087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "ba33f673a4fa412d8c9d44f96cc1bd18"
format_stamp: "Formatted at 2026-08-11 01:36:29 on dist-test-slave-9jjr"
server_key: "7cf6424f5069ff8b4cd1e45faf81a5d8"
server_key_iv: "aa7366ea566377f58bdee44673f6c2ec"
server_key_version: "encryptionkey@0"
I20260811 01:36:29.021907 15087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "ba33f673a4fa412d8c9d44f96cc1bd18"
format_stamp: "Formatted at 2026-08-11 01:36:29 on dist-test-slave-9jjr"
server_key: "7cf6424f5069ff8b4cd1e45faf81a5d8"
server_key_iv: "aa7366ea566377f58bdee44673f6c2ec"
server_key_version: "encryptionkey@0"
I20260811 01:36:29.027338 15087 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 01:36:29.030795 15103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:29.032126 15087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:29.032339 15087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "ba33f673a4fa412d8c9d44f96cc1bd18"
format_stamp: "Formatted at 2026-08-11 01:36:29 on dist-test-slave-9jjr"
server_key: "7cf6424f5069ff8b4cd1e45faf81a5d8"
server_key_iv: "aa7366ea566377f58bdee44673f6c2ec"
server_key_version: "encryptionkey@0"
I20260811 01:36:29.032522 15087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:29.038509 15087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:29.042845 15087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:29.043128 15087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:29.062741 15087 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34823
I20260811 01:36:29.062788 15156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34823 every 8 connection(s)
I20260811 01:36:29.064230 15087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:29.068058 15157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:29.073367 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15087
I20260811 01:36:29.073551 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:29.074029 23711 external_mini_cluster.cc:1428] Setting key 56dc68657a43d5a166fbce7585ab8ff2
I20260811 01:36:29.079355 15157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18: Bootstrap starting.
I20260811 01:36:29.082042 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:29.075958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51687 (local address 127.0.0.1:34823)
0811 01:36:29.076816 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:29.076831 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:29.076875 (+ 44us) server_negotiation.cc:407] Connection header received
0811 01:36:29.078641 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:29.078666 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:29.079020 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:29.079426 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:29.080470 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:29.080476 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:29.080487 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:29.080501 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:29.080551 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:29.080569 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:29.080873 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:29.081025 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 01:36:29.081178 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":396,"threads_started":1}
I20260811 01:36:29.083033 15157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:29.084239 15157 log.cc:824] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:29.086043 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:29.087366 15157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18: No bootstrap required, opened a new log
I20260811 01:36:29.093093 15160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:29.090508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40655 (local address 127.0.0.1:34823)
0811 01:36:29.090787 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:29.090794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:29.091147 (+ 353us) server_negotiation.cc:407] Connection header received
0811 01:36:29.091338 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:29.091341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:29.091388 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:29.091467 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:29.092430 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:29.092438 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:29.092441 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:29.092456 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:29.092491 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:29.092508 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:29.092604 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:29.092730 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 01:36:29.092784 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:36:29.096884 15157 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260811 01:36:29.097282 15157 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:29.097398 15157 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba33f673a4fa412d8c9d44f96cc1bd18, State: Initialized, Role: FOLLOWER
I20260811 01:36:29.098028 15157 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260811 01:36:29.098414 15157 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:29.098580 15157 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:29.098775 15157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:29.100999 15157 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260811 01:36:29.101497 15157 leader_election.cc:302] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba33f673a4fa412d8c9d44f96cc1bd18; no voters:
I20260811 01:36:29.102065 15157 leader_election.cc:288] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:29.102236 15169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:29.102919 15169 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [term 1 LEADER]: Becoming Leader. State: Replica: ba33f673a4fa412d8c9d44f96cc1bd18, State: Running, Role: LEADER
I20260811 01:36:29.103519 15169 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } }
I20260811 01:36:29.104449 15157 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:29.106515 15170 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } } }
I20260811 01:36:29.107164 15170 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:29.107125 15171 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba33f673a4fa412d8c9d44f96cc1bd18. Latest consensus state: current_term: 1 leader_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba33f673a4fa412d8c9d44f96cc1bd18" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34823 } } }
I20260811 01:36:29.107542 15171 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:29.115185 15175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:29.120352 15175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:29.129642 15175 catalog_manager.cc:1347] Generated new cluster ID: 904030ff00ae4621bbf335279d47783c
I20260811 01:36:29.129767 15175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:29.155647 15175 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:29.156173 15175 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:29.172402 15175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba33f673a4fa412d8c9d44f96cc1bd18: Generated new TSK 0
I20260811 01:36:29.173249 15175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:29.187317 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15087
W20260811 01:36:29.188460 15152 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51687
W20260811 01:36:29.189162 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15087: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:29.189320 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15087
2026-08-11T01:36:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2145 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:29 dist-test-slave-9jjr krb5kdc[15192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:29 dist-test-slave-9jjr krb5kdc[15192](info): set up 2 sockets
Aug 11 01:36:29 dist-test-slave-9jjr krb5kdc[15192](info): commencing operation
krb5kdc: starting...
W20260811 01:36:30.420931 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:30 dist-test-slave-9jjr krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:30.774506 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:31.134984 15205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:31.135308 15205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:31.135406 15205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:31.142974 15205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:31.143127 15205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:31.143177 15205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:31.143240 15205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:31.143285 15205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:31.153797 15205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:31.155213 15205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:31.156548 15205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:31.168936 15211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:31.168998 15212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:31.168864 15214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:31.170095 15205 server_base.cc:1034] running on GCE node
I20260811 01:36:31.171030 15205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:31.172448 15205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:31.173679 15205 hybrid_clock.cc:648] HybridClock initialized: now 1786412191173648 us; error 40 us; skew 500 ppm
I20260811 01:36:31.174034 15205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:31 dist-test-slave-9jjr krb5kdc[15192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:31.184736 15205 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:31.186600 15205 webserver.cc:460] Webserver started at http://127.0.0.1:42069/ using document root <none> and password file <none>
I20260811 01:36:31.187341 15205 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:31.187496 15205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:31.187835 15205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:31.191147 15205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b1450f4cf99e4fbba83e9978ec37c7e5"
format_stamp: "Formatted at 2026-08-11 01:36:31 on dist-test-slave-9jjr"
server_key: "3f339e3651235d1b2bb829d038f79922"
server_key_iv: "9fc2b92d16e370497939dd3f8849cd2b"
server_key_version: "encryptionkey@0"
I20260811 01:36:31.191962 15205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b1450f4cf99e4fbba83e9978ec37c7e5"
format_stamp: "Formatted at 2026-08-11 01:36:31 on dist-test-slave-9jjr"
server_key: "3f339e3651235d1b2bb829d038f79922"
server_key_iv: "9fc2b92d16e370497939dd3f8849cd2b"
server_key_version: "encryptionkey@0"
I20260811 01:36:31.197149 15205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 01:36:31.200629 15222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:31.201910 15205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:31.202224 15205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b1450f4cf99e4fbba83e9978ec37c7e5"
format_stamp: "Formatted at 2026-08-11 01:36:31 on dist-test-slave-9jjr"
server_key: "3f339e3651235d1b2bb829d038f79922"
server_key_iv: "9fc2b92d16e370497939dd3f8849cd2b"
server_key_version: "encryptionkey@0"
I20260811 01:36:31.202431 15205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:31.229034 15205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:31.234766 15205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:31.235123 15205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:31.259410 15205 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41789
I20260811 01:36:31.259464 15277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41789 every 8 connection(s)
I20260811 01:36:31.261303 15205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:31.266815 15278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:31.270241 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15205
I20260811 01:36:31.270431 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:31.270869 23711 external_mini_cluster.cc:1428] Setting key 1519b41c7b097731019203fa12ddb308
I20260811 01:36:31.278916 15278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5: Bootstrap starting.
I20260811 01:36:31.282143 15278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:31.283390 15278 log.cc:824] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:36:31 dist-test-slave-9jjr krb5kdc[15192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:36:31.286973 15278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5: No bootstrap required, opened a new log
I20260811 01:36:31.295535 15281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:31.272899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:41607 (local address 127.0.0.1:41789)
0811 01:36:31.273687 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:31.273701 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:31.273742 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:36:31.275473 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:31.275497 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:31.275914 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:31.276321 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:31.277831 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:31.279296 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:31.280637 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:31.281341 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:31.281556 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:31.287185 (+ 5629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:31.287195 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:31.287212 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:31.287255 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:31.290869 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:31.291837 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:31.291845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:31.291852 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:31.292041 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:31.292567 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:31.292571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:31.292573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:31.293150 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:31.293495 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:31.294059 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 01:36:31.294445 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":331,"threads_started":1}
I20260811 01:36:31.295656 15278 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260811 01:36:31.296167 15278 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:31.296294 15278 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1450f4cf99e4fbba83e9978ec37c7e5, State: Initialized, Role: FOLLOWER
I20260811 01:36:31.296913 15278 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260811 01:36:31.297184 15278 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:31.297355 15278 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:31.297550 15278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:31.300222 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:31.300462 15278 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260811 01:36:31.301028 15278 leader_election.cc:302] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1450f4cf99e4fbba83e9978ec37c7e5; no voters:
I20260811 01:36:31.301726 15278 leader_election.cc:288] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:31.301834 15283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:31.304596 15278 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:31.306648 15283 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [term 1 LEADER]: Becoming Leader. State: Replica: b1450f4cf99e4fbba83e9978ec37c7e5, State: Running, Role: LEADER
I20260811 01:36:31.307447 15283 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260811 01:36:31.310910 15284 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } } }
I20260811 01:36:31.311331 15284 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:31.312788 15285 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1450f4cf99e4fbba83e9978ec37c7e5. Latest consensus state: current_term: 1 leader_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1450f4cf99e4fbba83e9978ec37c7e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } } }
I20260811 01:36:31.313460 15285 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:31.316810 15293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:31.322932 15293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:31.330331 15281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:31.305660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:60113 (local address 127.0.0.1:41789)
0811 01:36:31.305926 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:31.305936 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:31.306953 (+ 1017us) server_negotiation.cc:407] Connection header received
0811 01:36:31.307385 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:31.307391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:31.307481 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:31.307594 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:31.309205 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:31.310511 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:31.312298 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:31.313546 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:31.313721 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:31.318589 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:31.318597 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:31.318602 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:31.318643 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:31.324065 (+ 5422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:31.325718 (+ 1653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:31.325727 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:31.325733 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:31.325949 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:31.326796 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:31.326805 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:31.326811 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:31.327401 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:31.327778 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:31.329399 (+ 1621us) server_negotiation.cc:299] Negotiation successful
0811 01:36:31.329682 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 01:36:31.338429 15293 catalog_manager.cc:1347] Generated new cluster ID: 4eb2ddab460a45f1a56cda9aa93472e0
I20260811 01:36:31.338564 15293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:31.360584 15293 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:31.361968 15293 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:31.370785 15293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1450f4cf99e4fbba83e9978ec37c7e5: Generated new TSK 0
I20260811 01:36:31.371675 15293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:31.378880 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15205
I20260811 01:36:31.380141 15272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:31.474088 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15205
W20260811 01:36:31.495909 15190 connection.cc:535] client connection to 127.0.0.1:41789 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41789): Connection reset by peer (error 104)
2026-08-11T01:36:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2284 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:31 dist-test-slave-9jjr krb5kdc[15312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:31 dist-test-slave-9jjr krb5kdc[15312](info): set up 2 sockets
Aug 11 01:36:31 dist-test-slave-9jjr krb5kdc[15312](info): commencing operation
krb5kdc: starting...
W20260811 01:36:32.690922 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.004s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:32 dist-test-slave-9jjr krb5kdc[15312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:33.054824 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37945
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:33.417876 15326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:33.418320 15326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:33.418493 15326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:33.426265 15326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:33.426399 15326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:33.426481 15326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:33.426561 15326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:33.426626 15326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:33.437454 15326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:33.438951 15326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:33.440399 15326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:33.453177 15331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:33.453125 15334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:33.453244 15332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:33.454377 15326 server_base.cc:1034] running on GCE node
I20260811 01:36:33.455271 15326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:33.456769 15326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:33.457991 15326 hybrid_clock.cc:648] HybridClock initialized: now 1786412193457949 us; error 34 us; skew 500 ppm
I20260811 01:36:33.458439 15326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:33 dist-test-slave-9jjr krb5kdc[15312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412193, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:33.461898 15326 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:33.463536 15326 webserver.cc:460] Webserver started at http://127.0.0.1:45885/ using document root <none> and password file <none>
I20260811 01:36:33.464246 15326 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:33.464356 15326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:33.464623 15326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:33.467871 15326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b00c031f3c8043dbb9f963cc768b73b5"
format_stamp: "Formatted at 2026-08-11 01:36:33 on dist-test-slave-9jjr"
server_key: "abf3a05927650cc36ab4d1e13edc1079"
server_key_iv: "52f99618063ae9d7abac58e6b73277a7"
server_key_version: "encryptionkey@0"
I20260811 01:36:33.468621 15326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b00c031f3c8043dbb9f963cc768b73b5"
format_stamp: "Formatted at 2026-08-11 01:36:33 on dist-test-slave-9jjr"
server_key: "abf3a05927650cc36ab4d1e13edc1079"
server_key_iv: "52f99618063ae9d7abac58e6b73277a7"
server_key_version: "encryptionkey@0"
I20260811 01:36:33.474061 15326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 01:36:33.477640 15341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:33.479112 15326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:33.479306 15326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b00c031f3c8043dbb9f963cc768b73b5"
format_stamp: "Formatted at 2026-08-11 01:36:33 on dist-test-slave-9jjr"
server_key: "abf3a05927650cc36ab4d1e13edc1079"
server_key_iv: "52f99618063ae9d7abac58e6b73277a7"
server_key_version: "encryptionkey@0"
I20260811 01:36:33.479521 15326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:33.498278 15326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:33.503089 15326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:33.503427 15326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:33.523829 15326 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37945
I20260811 01:36:33.523867 15395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37945 every 8 connection(s)
I20260811 01:36:33.525290 15326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:33.529182 15396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:33.532395 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15326
I20260811 01:36:33.532603 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:33.533185 23711 external_mini_cluster.cc:1428] Setting key 81d98a730d4f26e9409efbcb14f63a53
I20260811 01:36:33.541867 15396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5: Bootstrap starting.
I20260811 01:36:33.545084 15396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:33.546231 15396 log.cc:824] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:33.548367 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:33.535385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:44201 (local address 127.0.0.1:37945)
0811 01:36:33.536198 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:33.536211 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:33.536254 (+ 43us) server_negotiation.cc:407] Connection header received
0811 01:36:33.538429 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:33.538457 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:33.538956 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:33.539488 (+ 532us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:33.540169 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:33.541578 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:33.543354 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:33.544081 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:33.544310 (+ 229us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:33.545786 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:33.545795 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:33.545809 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:33.546559 (+ 750us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:33.546655 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:33.546685 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:33.546875 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:33.547189 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 01:36:33.547369 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":317,"threads_started":1}
I20260811 01:36:33.549302 15396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5: No bootstrap required, opened a new log
I20260811 01:36:33.552585 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:33.559530 15396 raft_consensus.cc:348] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } }
I20260811 01:36:33.559965 15396 raft_consensus.cc:374] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:33.560111 15396 raft_consensus.cc:729] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b00c031f3c8043dbb9f963cc768b73b5, State: Initialized, Role: FOLLOWER
I20260811 01:36:33.560807 15396 consensus_queue.cc:260] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } }
I20260811 01:36:33.561096 15396 raft_consensus.cc:388] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:33.561245 15396 raft_consensus.cc:482] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:33.561460 15396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:33.564729 15396 raft_consensus.cc:504] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } }
I20260811 01:36:33.565382 15396 leader_election.cc:302] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b00c031f3c8043dbb9f963cc768b73b5; no voters:
I20260811 01:36:33.566190 15396 leader_election.cc:288] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:33.566223 15400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:33.558270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:44699 (local address 127.0.0.1:37945)
0811 01:36:33.558480 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:33.558486 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:33.559017 (+ 531us) server_negotiation.cc:407] Connection header received
0811 01:36:33.559191 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:33.559197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:33.559283 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:33.559412 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:33.560000 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:33.561164 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:33.563209 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:33.563753 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:33.563860 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:33.565216 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:33.565221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:33.565225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:33.565268 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:33.565311 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:33.565328 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:33.565426 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:33.565702 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 01:36:33.565780 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:36:33.566334 15410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:33.568004 15410 raft_consensus.cc:686] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [term 1 LEADER]: Becoming Leader. State: Replica: b00c031f3c8043dbb9f963cc768b73b5, State: Running, Role: LEADER
I20260811 01:36:33.568799 15396 sys_catalog.cc:564] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:33.568660 15410 consensus_queue.cc:237] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } }
I20260811 01:36:33.572024 15412 sys_catalog.cc:455] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b00c031f3c8043dbb9f963cc768b73b5. Latest consensus state: current_term: 1 leader_uuid: "b00c031f3c8043dbb9f963cc768b73b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } } }
I20260811 01:36:33.572434 15412 sys_catalog.cc:458] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:33.573024 15411 sys_catalog.cc:455] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b00c031f3c8043dbb9f963cc768b73b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b00c031f3c8043dbb9f963cc768b73b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37945 } } }
I20260811 01:36:33.573388 15411 sys_catalog.cc:458] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:33.579495 15418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:33.584395 15418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:33.592619 15418 catalog_manager.cc:1347] Generated new cluster ID: feddbbf5d1814ec38411cfe9ad1a41a2
I20260811 01:36:33.592741 15418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:33.610611 15418 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:33.611917 15418 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:33.630463 15418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b00c031f3c8043dbb9f963cc768b73b5: Generated new TSK 0
I20260811 01:36:33.631333 15418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:33.642935 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15326
W20260811 01:36:33.644601 15391 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.229:44201
W20260811 01:36:33.645538 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15326: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:33.645666 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15326
W20260811 01:36:33.667694 15309 connection.cc:535] client connection to 127.0.0.1:37945 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37945): Connection reset by peer (error 104)
2026-08-11T01:36:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2171 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:33 dist-test-slave-9jjr krb5kdc[15432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:33 dist-test-slave-9jjr krb5kdc[15432](info): set up 2 sockets
Aug 11 01:36:33 dist-test-slave-9jjr krb5kdc[15432](info): commencing operation
krb5kdc: starting...
W20260811 01:36:34.879712 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:35 dist-test-slave-9jjr krb5kdc[15432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:35.238011 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46445
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:35.593425 15447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:35.593729 15447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:35.593905 15447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:35.601420 15447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:35.601572 15447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:35.601672 15447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:35.601871 15447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:35.601951 15447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:35.613085 15447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:35.614531 15447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:35.615928 15447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:35.628360 15452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:35.628428 15453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:35.628291 15455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:35.629949 15447 server_base.cc:1034] running on GCE node
I20260811 01:36:35.630946 15447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:35.632622 15447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:35.633869 15447 hybrid_clock.cc:648] HybridClock initialized: now 1786412195633804 us; error 66 us; skew 500 ppm
I20260811 01:36:35.634303 15447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:35 dist-test-slave-9jjr krb5kdc[15432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412195, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:35.637683 15447 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:35.639334 15447 webserver.cc:460] Webserver started at http://127.0.0.1:33893/ using document root <none> and password file <none>
I20260811 01:36:35.640038 15447 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:35.640198 15447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:35.640518 15447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:35.643815 15447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "7b39f4ae4a0444d7922435ab7e746191"
format_stamp: "Formatted at 2026-08-11 01:36:35 on dist-test-slave-9jjr"
server_key: "8d2ef2ecc932823b7d5c80e121c5c5bc"
server_key_iv: "effabda6322a3b145155e1e40f99f6e7"
server_key_version: "encryptionkey@0"
I20260811 01:36:35.644932 15447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "7b39f4ae4a0444d7922435ab7e746191"
format_stamp: "Formatted at 2026-08-11 01:36:35 on dist-test-slave-9jjr"
server_key: "8d2ef2ecc932823b7d5c80e121c5c5bc"
server_key_iv: "effabda6322a3b145155e1e40f99f6e7"
server_key_version: "encryptionkey@0"
I20260811 01:36:35.651237 15447 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 01:36:35.655186 15462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:35.656666 15447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:35.656850 15447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "7b39f4ae4a0444d7922435ab7e746191"
format_stamp: "Formatted at 2026-08-11 01:36:35 on dist-test-slave-9jjr"
server_key: "8d2ef2ecc932823b7d5c80e121c5c5bc"
server_key_iv: "effabda6322a3b145155e1e40f99f6e7"
server_key_version: "encryptionkey@0"
I20260811 01:36:35.657063 15447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:35.662971 15447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:35.667429 15447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:35.667768 15447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:35.687866 15447 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46445
I20260811 01:36:35.687914 15519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46445 every 8 connection(s)
I20260811 01:36:35.689384 15447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:35.693300 15520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:35.693341 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15447
I20260811 01:36:35.693572 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:35.694036 23711 external_mini_cluster.cc:1428] Setting key a704d8c6e318a8115776aacb0befef96
I20260811 01:36:35.702351 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:35.695895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:55487 (local address 127.0.0.1:46445)
0811 01:36:35.696809 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:35.696821 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:35.696872 (+ 51us) server_negotiation.cc:407] Connection header received
0811 01:36:35.698565 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:35.698588 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:35.698938 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:35.699314 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:35.700504 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:35.700510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:35.700523 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:35.700542 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:35.700612 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:35.700633 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:35.700821 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:35.700939 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 01:36:35.701164 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":434,"threads_started":1}
I20260811 01:36:35.706334 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:35.707816 15520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191: Bootstrap starting.
I20260811 01:36:35.712211 15520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:35.713552 15520 log.cc:824] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:35.714874 15523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:35.711804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:60875 (local address 127.0.0.1:46445)
0811 01:36:35.712020 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:35.712029 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:35.712504 (+ 475us) server_negotiation.cc:407] Connection header received
0811 01:36:35.712656 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:35.712662 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:35.712751 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:35.712878 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:35.714009 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:35.714016 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:35.714023 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:35.714049 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:35.714106 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:35.714183 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:35.714333 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:35.714503 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 01:36:35.714554 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 01:36:35.717011 15520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191: No bootstrap required, opened a new log
I20260811 01:36:35.724885 15520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } }
I20260811 01:36:35.725322 15520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:35.725461 15520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b39f4ae4a0444d7922435ab7e746191, State: Initialized, Role: FOLLOWER
I20260811 01:36:35.726227 15520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } }
I20260811 01:36:35.726482 15520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:35.726650 15520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:35.726812 15520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:35.729511 15520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } }
I20260811 01:36:35.730079 15520 leader_election.cc:302] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b39f4ae4a0444d7922435ab7e746191; no voters:
I20260811 01:36:35.730859 15520 leader_election.cc:288] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:35.731042 15530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:35.731878 15530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [term 1 LEADER]: Becoming Leader. State: Replica: 7b39f4ae4a0444d7922435ab7e746191, State: Running, Role: LEADER
I20260811 01:36:35.732534 15530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } }
I20260811 01:36:35.733284 15520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:35.736115 15531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b39f4ae4a0444d7922435ab7e746191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } } }
I20260811 01:36:35.736586 15531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:35.737445 15532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b39f4ae4a0444d7922435ab7e746191. Latest consensus state: current_term: 1 leader_uuid: "7b39f4ae4a0444d7922435ab7e746191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b39f4ae4a0444d7922435ab7e746191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46445 } } }
I20260811 01:36:35.737859 15532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:35.738644 15537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:35.744663 15537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:35.754740 15537 catalog_manager.cc:1347] Generated new cluster ID: 90da640107d64fb7a33bfbd875c3cc67
I20260811 01:36:35.754890 15537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:35.781947 15537 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:35.782512 15537 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:35.804617 15537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b39f4ae4a0444d7922435ab7e746191: Generated new TSK 0
I20260811 01:36:35.805739 15537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:35.816298 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15447
W20260811 01:36:35.817456 15513 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.229:55487
W20260811 01:36:35.818343 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15447: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:35.818507 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15447
2026-08-11T01:36:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2170 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:35 dist-test-slave-9jjr krb5kdc[15551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:35 dist-test-slave-9jjr krb5kdc[15551](info): set up 2 sockets
Aug 11 01:36:35 dist-test-slave-9jjr krb5kdc[15551](info): commencing operation
krb5kdc: starting...
W20260811 01:36:37.014721 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:37 dist-test-slave-9jjr krb5kdc[15551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:37.373608 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32899
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:37.739884 15568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:37.740260 15568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:37.740439 15568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:37.747740 15568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:37.747905 15568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:37.748020 15568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:37.748132 15568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:37.748214 15568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:37.759137 15568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32899
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:37.760584 15568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:37.761958 15568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:37.774312 15573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:37.774389 15575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:37.774421 15577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:37.775703 15568 server_base.cc:1034] running on GCE node
I20260811 01:36:37.776579 15568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:37.778208 15568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:37.779450 15568 hybrid_clock.cc:648] HybridClock initialized: now 1786412197779416 us; error 36 us; skew 500 ppm
I20260811 01:36:37.779829 15568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:37 dist-test-slave-9jjr krb5kdc[15551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412197, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:37.787849 15568 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:37.789595 15568 webserver.cc:460] Webserver started at http://127.0.0.1:43165/ using document root <none> and password file <none>
I20260811 01:36:37.790508 15568 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:37.790638 15568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:37.790936 15568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:37.794390 15568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1"
format_stamp: "Formatted at 2026-08-11 01:36:37 on dist-test-slave-9jjr"
server_key: "32764a5f2ec206b6a9a4a67a2b9a5cb9"
server_key_iv: "be97839887a1a37e1b25a56e304b7bc6"
server_key_version: "encryptionkey@0"
I20260811 01:36:37.795245 15568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1"
format_stamp: "Formatted at 2026-08-11 01:36:37 on dist-test-slave-9jjr"
server_key: "32764a5f2ec206b6a9a4a67a2b9a5cb9"
server_key_iv: "be97839887a1a37e1b25a56e304b7bc6"
server_key_version: "encryptionkey@0"
I20260811 01:36:37.801177 15568 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 01:36:37.805173 15584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:37.806751 15568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:37.806917 15568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1"
format_stamp: "Formatted at 2026-08-11 01:36:37 on dist-test-slave-9jjr"
server_key: "32764a5f2ec206b6a9a4a67a2b9a5cb9"
server_key_iv: "be97839887a1a37e1b25a56e304b7bc6"
server_key_version: "encryptionkey@0"
I20260811 01:36:37.807222 15568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:37.829823 15568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:37.834553 15568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:37.834864 15568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:37.855013 15568 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32899
I20260811 01:36:37.855055 15637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32899 every 8 connection(s)
I20260811 01:36:37.856472 15568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:37.860559 15638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:37.862540 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15568
I20260811 01:36:37.862762 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:37.863395 23711 external_mini_cluster.cc:1428] Setting key 185c607504e82c9c838e8c5001b07693
I20260811 01:36:37.874539 15638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1: Bootstrap starting.
Aug 11 01:36:37 dist-test-slave-9jjr krb5kdc[15551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 01:36:37.878165 15638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:37.879545 15638 log.cc:824] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:37.883108 15638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1: No bootstrap required, opened a new log
I20260811 01:36:37.888084 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:37.865514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:55545 (local address 127.0.0.1:32899)
0811 01:36:37.866479 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:37.866492 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:37.866538 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:36:37.868197 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:37.868220 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:37.868677 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:37.869093 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:37.870802 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:37.872156 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:37.873492 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:37.874263 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:37.874458 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:37.879501 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:37.879509 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:37.879525 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:37.879583 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:37.883236 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:37.884329 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:37.884336 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:37.884343 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:37.884517 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:37.885071 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:37.885075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:37.885077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:37.885688 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:37.885940 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:37.886581 (+ 641us) server_negotiation.cc:299] Negotiation successful
0811 01:36:37.886946 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":378,"threads_started":1}
I20260811 01:36:37.892335 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:37.892230 15638 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } }
I20260811 01:36:37.892702 15638 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:37.892805 15638 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7d9e4b3b924c0481bd8bdd2588dea1, State: Initialized, Role: FOLLOWER
I20260811 01:36:37.893431 15638 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } }
I20260811 01:36:37.893720 15638 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:37.893848 15638 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:37.894007 15638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:37.897565 15638 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } }
I20260811 01:36:37.898279 15638 leader_election.cc:302] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce7d9e4b3b924c0481bd8bdd2588dea1; no voters:
I20260811 01:36:37.899035 15638 leader_election.cc:288] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:37.899189 15649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:37.901542 15638 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:37.901841 15649 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [term 1 LEADER]: Becoming Leader. State: Replica: ce7d9e4b3b924c0481bd8bdd2588dea1, State: Running, Role: LEADER
I20260811 01:36:37.902566 15649 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } }
I20260811 01:36:37.905886 15651 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce7d9e4b3b924c0481bd8bdd2588dea1. Latest consensus state: current_term: 1 leader_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } } }
I20260811 01:36:37.906354 15651 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:37.909637 15650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7d9e4b3b924c0481bd8bdd2588dea1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32899 } } }
I20260811 01:36:37.910851 15656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:37.910862 15650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:37.918289 15656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:37.919553 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:37.898187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:45037 (local address 127.0.0.1:32899)
0811 01:36:37.898535 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:37.898542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:37.898950 (+ 408us) server_negotiation.cc:407] Connection header received
0811 01:36:37.899170 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:37.899180 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:37.899263 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:37.899386 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:37.901596 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:37.902929 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:37.904918 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:37.905862 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:37.906004 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:37.910903 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:37.910913 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:37.910921 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:37.910977 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:37.914941 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:37.916177 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:37.916183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:37.916187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:37.916387 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:37.917007 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:37.917014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:37.917017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:37.917478 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:37.917778 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:37.918954 (+ 1176us) server_negotiation.cc:299] Negotiation successful
0811 01:36:37.919160 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260811 01:36:37.929265 15656 catalog_manager.cc:1347] Generated new cluster ID: a7835b1e998942c8b155482ef95456b4
I20260811 01:36:37.929411 15656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:37.942638 15656 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:37.944070 15656 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:37.954329 15656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce7d9e4b3b924c0481bd8bdd2588dea1: Generated new TSK 0
I20260811 01:36:37.955240 15656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:37.960793 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15568
I20260811 01:36:37.962345 15632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:38.056993 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15568
W20260811 01:36:38.078235 15549 connection.cc:535] client connection to 127.0.0.1:32899 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32899): Connection reset by peer (error 104)
2026-08-11T01:36:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2240 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:38 dist-test-slave-9jjr krb5kdc[15675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:38 dist-test-slave-9jjr krb5kdc[15675](info): set up 2 sockets
Aug 11 01:36:38 dist-test-slave-9jjr krb5kdc[15675](info): commencing operation
krb5kdc: starting...
W20260811 01:36:39.288712 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:39 dist-test-slave-9jjr krb5kdc[15675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:39.666857 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37633
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:40.043135 15688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:40.043509 15688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:40.043617 15688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:40.051534 15688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:40.051683 15688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:40.051769 15688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:40.051890 15688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:40.051959 15688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:40.063105 15688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37633
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:40.064587 15688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:40.065984 15688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:40.079685 15695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:40.079718 15693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:40.079789 15698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:40.080778 15688 server_base.cc:1034] running on GCE node
I20260811 01:36:40.081815 15688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:40.083566 15688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:40.084872 15688 hybrid_clock.cc:648] HybridClock initialized: now 1786412200084809 us; error 38 us; skew 500 ppm
I20260811 01:36:40.085302 15688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:40 dist-test-slave-9jjr krb5kdc[15675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412200, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:40.088922 15688 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:40.090724 15688 webserver.cc:460] Webserver started at http://127.0.0.1:39509/ using document root <none> and password file <none>
I20260811 01:36:40.091437 15688 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:40.091557 15688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:40.091823 15688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:40.095523 15688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "3683f9b53fe54a3faef69de9d0f51a06"
format_stamp: "Formatted at 2026-08-11 01:36:40 on dist-test-slave-9jjr"
server_key: "941d56166e047b9ace1e3866368447fe"
server_key_iv: "0c42ffffdc7e4117e1307aea360f593e"
server_key_version: "encryptionkey@0"
I20260811 01:36:40.096418 15688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "3683f9b53fe54a3faef69de9d0f51a06"
format_stamp: "Formatted at 2026-08-11 01:36:40 on dist-test-slave-9jjr"
server_key: "941d56166e047b9ace1e3866368447fe"
server_key_iv: "0c42ffffdc7e4117e1307aea360f593e"
server_key_version: "encryptionkey@0"
I20260811 01:36:40.102741 15688 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:36:40.107162 15705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:40.109050 15688 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 01:36:40.109277 15688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "3683f9b53fe54a3faef69de9d0f51a06"
format_stamp: "Formatted at 2026-08-11 01:36:40 on dist-test-slave-9jjr"
server_key: "941d56166e047b9ace1e3866368447fe"
server_key_iv: "0c42ffffdc7e4117e1307aea360f593e"
server_key_version: "encryptionkey@0"
I20260811 01:36:40.109513 15688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:40.136456 15688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:40.141489 15688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:40.141783 15688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:40.162967 15688 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37633
I20260811 01:36:40.163023 15759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37633 every 8 connection(s)
I20260811 01:36:40.164567 15688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:40.166920 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15688
I20260811 01:36:40.167120 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:40.167624 23711 external_mini_cluster.cc:1428] Setting key be377c3c442e51b0e434124c1cae6dd4
I20260811 01:36:40.169247 15760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:40.183837 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:40.169717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:39753 (local address 127.0.0.1:37633)
0811 01:36:40.170683 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:40.170695 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:40.170741 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:36:40.172429 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:40.172459 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:40.172938 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:40.173340 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:40.174377 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:40.175885 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:40.177906 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:40.178872 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:40.179040 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:40.180764 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:40.180773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:40.180795 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:40.181665 (+ 870us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:40.181775 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:40.181809 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:40.181949 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:40.182424 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 01:36:40.182719 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":496,"threads_started":1}
I20260811 01:36:40.184792 15760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06: Bootstrap starting.
I20260811 01:36:40.188447 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:40.188620 15760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:40.189692 15760 log.cc:824] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:40.193156 15760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06: No bootstrap required, opened a new log
I20260811 01:36:40.201210 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:40.193637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:52633 (local address 127.0.0.1:37633)
0811 01:36:40.193947 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:40.193954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:40.194431 (+ 477us) server_negotiation.cc:407] Connection header received
0811 01:36:40.194587 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:40.194590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:40.194657 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:40.194758 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:40.195452 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:40.196261 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:40.198294 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:40.198812 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:40.198923 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:40.200351 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:40.200356 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:40.200359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:40.200378 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:40.200419 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:40.200436 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:40.200529 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:40.200747 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 01:36:40.200850 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260811 01:36:40.204001 15760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260811 01:36:40.204452 15760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:40.204576 15760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3683f9b53fe54a3faef69de9d0f51a06, State: Initialized, Role: FOLLOWER
I20260811 01:36:40.205238 15760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260811 01:36:40.205500 15760 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:40.205670 15760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:40.205860 15760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:40.208405 15760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260811 01:36:40.209061 15760 leader_election.cc:302] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3683f9b53fe54a3faef69de9d0f51a06; no voters:
I20260811 01:36:40.209812 15760 leader_election.cc:288] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:40.209971 15771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:40.210806 15771 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [term 1 LEADER]: Becoming Leader. State: Replica: 3683f9b53fe54a3faef69de9d0f51a06, State: Running, Role: LEADER
I20260811 01:36:40.211440 15771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260811 01:36:40.212147 15760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:40.214851 15773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3683f9b53fe54a3faef69de9d0f51a06. Latest consensus state: current_term: 1 leader_uuid: "3683f9b53fe54a3faef69de9d0f51a06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } } }
I20260811 01:36:40.215039 15772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3683f9b53fe54a3faef69de9d0f51a06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3683f9b53fe54a3faef69de9d0f51a06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } } }
I20260811 01:36:40.215438 15772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:40.215446 15773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:40.216580 15779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:40.223812 15779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:40.234517 15779 catalog_manager.cc:1347] Generated new cluster ID: 5065e28e97774eeabc09e820f1ccb044
I20260811 01:36:40.234681 15779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:40.265503 15779 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:40.267117 15779 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:40.275897 15779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3683f9b53fe54a3faef69de9d0f51a06: Generated new TSK 0
I20260811 01:36:40.276907 15779 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:40.284613 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15688
W20260811 01:36:40.285964 15755 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.229:39753
W20260811 01:36:40.287176 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15688: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:40.287359 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15688
W20260811 01:36:40.309818 15673 connection.cc:535] client connection to 127.0.0.1:37633 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37633): Connection reset by peer (error 104)
2026-08-11T01:36:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2232 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:40 dist-test-slave-9jjr krb5kdc[15793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:40 dist-test-slave-9jjr krb5kdc[15793](info): set up 2 sockets
Aug 11 01:36:40 dist-test-slave-9jjr krb5kdc[15793](info): commencing operation
krb5kdc: starting...
W20260811 01:36:41.553146 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.002s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:41 dist-test-slave-9jjr krb5kdc[15793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 01:36:41.930792 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:42.295248 15809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:42.295579 15809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:42.295734 15809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:42.303324 15809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:42.303463 15809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:42.303555 15809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:42.303644 15809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:42.303735 15809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:42.314280 15809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43733
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:42.315696 15809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:42.317065 15809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:42.329933 15818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:42.329938 15816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:42.330411 15815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:42.330976 15809 server_base.cc:1034] running on GCE node
I20260811 01:36:42.331890 15809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:42.333391 15809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:42.334599 15809 hybrid_clock.cc:648] HybridClock initialized: now 1786412202334560 us; error 39 us; skew 500 ppm
I20260811 01:36:42.334929 15809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:42 dist-test-slave-9jjr krb5kdc[15793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412202, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:42.338322 15809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 01:36:42.339956 15809 webserver.cc:460] Webserver started at http://127.0.0.1:37035/ using document root <none> and password file <none>
I20260811 01:36:42.340684 15809 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:42.340837 15809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:42.341158 15809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:42.344421 15809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "4f59744605114b84b89d1864c645b608"
format_stamp: "Formatted at 2026-08-11 01:36:42 on dist-test-slave-9jjr"
server_key: "9711ebf88178468c63d78431daec37df"
server_key_iv: "caab44ed55b34bd723991841c855d556"
server_key_version: "encryptionkey@0"
I20260811 01:36:42.345247 15809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "4f59744605114b84b89d1864c645b608"
format_stamp: "Formatted at 2026-08-11 01:36:42 on dist-test-slave-9jjr"
server_key: "9711ebf88178468c63d78431daec37df"
server_key_iv: "caab44ed55b34bd723991841c855d556"
server_key_version: "encryptionkey@0"
I20260811 01:36:42.350937 15809 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 01:36:42.354673 15825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:42.356109 15809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:36:42.356312 15809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "4f59744605114b84b89d1864c645b608"
format_stamp: "Formatted at 2026-08-11 01:36:42 on dist-test-slave-9jjr"
server_key: "9711ebf88178468c63d78431daec37df"
server_key_iv: "caab44ed55b34bd723991841c855d556"
server_key_version: "encryptionkey@0"
I20260811 01:36:42.356540 15809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:42.362763 15809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:42.367193 15809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:42.367506 15809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:42.387663 15809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43733
I20260811 01:36:42.387763 15878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43733 every 8 connection(s)
I20260811 01:36:42.389321 15809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:42.393205 15879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:42.398106 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15809
I20260811 01:36:42.398396 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:42.398870 23711 external_mini_cluster.cc:1428] Setting key bd3bc1d2ab526ca649fdae1bf0c61df5
I20260811 01:36:42.404856 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608: Bootstrap starting.
I20260811 01:36:42.407024 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:42.400759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:36549 (local address 127.0.0.1:43733)
0811 01:36:42.401586 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:42.401598 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:42.401644 (+ 46us) server_negotiation.cc:407] Connection header received
0811 01:36:42.403521 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:42.403545 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:42.403889 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:42.404218 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:42.405443 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:42.405450 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:42.405462 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:42.405481 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:42.405539 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:42.405558 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:42.405730 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:42.405857 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 01:36:42.406060 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":393,"threads_started":1}
I20260811 01:36:42.408350 15879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:42.409534 15879 log.cc:824] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:42.410882 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:42.413183 15879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608: No bootstrap required, opened a new log
I20260811 01:36:42.419317 15882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:42.416450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.229:37769 (local address 127.0.0.1:43733)
0811 01:36:42.416648 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:42.416656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:42.417218 (+ 562us) server_negotiation.cc:407] Connection header received
0811 01:36:42.417355 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:42.417360 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:42.417427 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:42.417549 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:42.418619 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:42.418625 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:42.418630 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:42.418650 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:42.418698 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:42.418725 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:42.418879 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:42.418943 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 01:36:42.419003 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:36:42.423313 15879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260811 01:36:42.423736 15879 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:42.423846 15879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f59744605114b84b89d1864c645b608, State: Initialized, Role: FOLLOWER
I20260811 01:36:42.424615 15879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260811 01:36:42.424891 15879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:42.425067 15879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:42.425277 15879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:42.427728 15879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260811 01:36:42.428294 15879 leader_election.cc:302] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f59744605114b84b89d1864c645b608; no voters:
I20260811 01:36:42.428952 15879 leader_election.cc:288] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:42.429127 15889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:42.430580 15889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [term 1 LEADER]: Becoming Leader. State: Replica: 4f59744605114b84b89d1864c645b608, State: Running, Role: LEADER
I20260811 01:36:42.431245 15889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } }
I20260811 01:36:42.431504 15879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:42.434346 15891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f59744605114b84b89d1864c645b608. Latest consensus state: current_term: 1 leader_uuid: "4f59744605114b84b89d1864c645b608" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } } }
I20260811 01:36:42.434365 15890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f59744605114b84b89d1864c645b608" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f59744605114b84b89d1864c645b608" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43733 } } }
I20260811 01:36:42.434860 15890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:42.434860 15891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:42.436062 15899 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:42.443230 15899 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:42.452041 15899 catalog_manager.cc:1347] Generated new cluster ID: fa7f395b03f847b3b7a8cfd20ed19e1c
I20260811 01:36:42.452172 15899 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:42.475419 15899 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:42.475905 15899 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:42.491686 15899 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f59744605114b84b89d1864c645b608: Generated new TSK 0
I20260811 01:36:42.492619 15899 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:42.500346 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15809
W20260811 01:36:42.501542 15874 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.229:36549
W20260811 01:36:42.502300 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15809: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:42.502462 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15809
2026-08-11T01:36:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2213 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:42 dist-test-slave-9jjr krb5kdc[15914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:42 dist-test-slave-9jjr krb5kdc[15914](info): set up 2 sockets
Aug 11 01:36:42 dist-test-slave-9jjr krb5kdc[15914](info): commencing operation
krb5kdc: starting...
W20260811 01:36:43.725664 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:43 dist-test-slave-9jjr krb5kdc[15914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:44.085959 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33519
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:33519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:44.435243 15927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:44.435632 15927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:44.435812 15927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:44.443267 15927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:44.443445 15927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:44.443562 15927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:44.443676 15927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:44.443768 15927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:44.453788 15927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:33519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:33519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:44.455200 15927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:44.456568 15927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:44.469164 15935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:44.469224 15933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:44.469432 15932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:44.470463 15927 server_base.cc:1034] running on GCE node
I20260811 01:36:44.471372 15927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:44.472815 15927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:44.474031 15927 hybrid_clock.cc:648] HybridClock initialized: now 1786412204473975 us; error 48 us; skew 500 ppm
I20260811 01:36:44.474478 15927 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:44 dist-test-slave-9jjr krb5kdc[15914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412204, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:44.482548 15927 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:44.484225 15927 webserver.cc:460] Webserver started at http://127.23.39.254:38263/ using document root <none> and password file <none>
I20260811 01:36:44.484946 15927 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:44.485105 15927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:44.485435 15927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:44.488682 15927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7"
format_stamp: "Formatted at 2026-08-11 01:36:44 on dist-test-slave-9jjr"
server_key: "f7d0308e8444a60e1c34e83a5f877870"
server_key_iv: "0bba4f0fb077f140fd918daf75c89d30"
server_key_version: "encryptionkey@0"
I20260811 01:36:44.489545 15927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7"
format_stamp: "Formatted at 2026-08-11 01:36:44 on dist-test-slave-9jjr"
server_key: "f7d0308e8444a60e1c34e83a5f877870"
server_key_iv: "0bba4f0fb077f140fd918daf75c89d30"
server_key_version: "encryptionkey@0"
I20260811 01:36:44.494930 15927 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:36:44.498440 15944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:44.499773 15927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:36:44.499966 15927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7"
format_stamp: "Formatted at 2026-08-11 01:36:44 on dist-test-slave-9jjr"
server_key: "f7d0308e8444a60e1c34e83a5f877870"
server_key_iv: "0bba4f0fb077f140fd918daf75c89d30"
server_key_version: "encryptionkey@0"
I20260811 01:36:44.500171 15927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:44.514545 15927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:44.518808 15927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:44.519151 15927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:44.538730 15927 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:33519
I20260811 01:36:44.538763 16001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:33519 every 8 connection(s)
I20260811 01:36:44.540133 15927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:44.541802 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 15927
I20260811 01:36:44.541999 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:44.542608 23711 external_mini_cluster.cc:1428] Setting key ddfa1aa4ae6e8c24361ec21075ad525a
I20260811 01:36:44.544641 16002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:44.555749 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7: Bootstrap starting.
Aug 11 01:36:44 dist-test-slave-9jjr krb5kdc[15914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:44.559275 16002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:44.560508 16002 log.cc:824] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:44.563371 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7: No bootstrap required, opened a new log
I20260811 01:36:44.565435 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:44.544537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47089 (local address 127.23.39.254:33519)
0811 01:36:44.545431 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:44.545443 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:44.545485 (+ 42us) server_negotiation.cc:407] Connection header received
0811 01:36:44.547163 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:44.547186 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:44.547570 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:44.547986 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:44.549470 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:44.550909 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:44.552372 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:44.553128 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:44.553365 (+ 237us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:44.557930 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:44.557937 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:44.557949 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:44.557983 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:44.561255 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:44.562032 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:44.562039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:44.562044 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:44.562265 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:44.562768 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:44.562773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:44.562776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:44.563276 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:44.563607 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:44.564120 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 01:36:44.564432 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":359,"threads_started":1}
I20260811 01:36:44.569463 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:44.571738 16002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } }
I20260811 01:36:44.572268 16002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:44.572393 16002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fffcdd68f6f4e04babcd6d99e37e3e7, State: Initialized, Role: FOLLOWER
I20260811 01:36:44.573064 16002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } }
I20260811 01:36:44.573323 16002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:44.573465 16002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:44.573640 16002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:44.577179 16002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } }
I20260811 01:36:44.577698 16002 leader_election.cc:302] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fffcdd68f6f4e04babcd6d99e37e3e7; no voters:
I20260811 01:36:44.578450 16002 leader_election.cc:288] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:44.578563 16012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:44.581107 16002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:44.581074 16012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1fffcdd68f6f4e04babcd6d99e37e3e7, State: Running, Role: LEADER
I20260811 01:36:44.581652 16012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } }
I20260811 01:36:44.587160 16015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fffcdd68f6f4e04babcd6d99e37e3e7. Latest consensus state: current_term: 1 leader_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } } }
I20260811 01:36:44.588207 16015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:44.587839 16014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffcdd68f6f4e04babcd6d99e37e3e7" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 33519 } } }
I20260811 01:36:44.588846 16014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:44.592072 16020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:44.592774 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:44.573996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45773 (local address 127.23.39.254:33519)
0811 01:36:44.574223 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:44.574231 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:44.574777 (+ 546us) server_negotiation.cc:407] Connection header received
0811 01:36:44.574942 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:44.574945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:44.575008 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:44.575089 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:44.576963 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:44.577792 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:44.579577 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:44.580045 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:44.580128 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:44.583148 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:44.583157 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:44.583167 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:44.583213 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:44.588145 (+ 4932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:44.589508 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:44.589516 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:44.589521 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:44.589712 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:44.590498 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:44.590510 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:44.590516 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:44.591027 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:44.591489 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:44.591967 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 01:36:44.592218 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:36:44.597211 16020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:44.606344 16020 catalog_manager.cc:1347] Generated new cluster ID: 9ebc4b284c774f29ac63e9e59ea11f2a
I20260811 01:36:44.606462 16020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:44.632109 16020 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:44.633548 16020 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:44.644816 16020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fffcdd68f6f4e04babcd6d99e37e3e7: Generated new TSK 0
I20260811 01:36:44.645810 16020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:44.655598 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 15927
I20260811 01:36:44.657922 15997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:44.758195 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 15927
W20260811 01:36:44.779994 15912 connection.cc:535] client connection to 127.23.39.254:33519 recv error: Network error: failed to read from TLS socket (remote: 127.23.39.254:33519): Connection reset by peer (error 104)
2026-08-11T01:36:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2255 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:44 dist-test-slave-9jjr krb5kdc[16035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:44 dist-test-slave-9jjr krb5kdc[16035](info): set up 2 sockets
Aug 11 01:36:44 dist-test-slave-9jjr krb5kdc[16035](info): commencing operation
krb5kdc: starting...
W20260811 01:36:45.966770 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.004s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:46 dist-test-slave-9jjr krb5kdc[16035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:46.334830 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:40825
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:35749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:40825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:46.704979 16048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:46.705363 16048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:46.705528 16048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:46.713124 16048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:46.713318 16048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:46.713428 16048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:46.713537 16048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:46.713615 16048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:46.724061 16048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:35749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:40825
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:40825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:46.725536 16048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:46.726974 16048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:46.739272 16056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:46.739400 16054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:46.739374 16053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:46.740180 16048 server_base.cc:1034] running on GCE node
I20260811 01:36:46.741042 16048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:46.742660 16048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:46.743912 16048 hybrid_clock.cc:648] HybridClock initialized: now 1786412206743880 us; error 63 us; skew 500 ppm
I20260811 01:36:46.744293 16048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:46 dist-test-slave-9jjr krb5kdc[16035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412206, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:46.747682 16048 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:46.749351 16048 webserver.cc:460] Webserver started at http://127.23.39.254:35533/ using document root <none> and password file <none>
I20260811 01:36:46.750083 16048 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:46.750305 16048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:46.750633 16048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:46.753767 16048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "38c755b1d5d2453d8e0630318ca79315"
format_stamp: "Formatted at 2026-08-11 01:36:46 on dist-test-slave-9jjr"
server_key: "7cf8ac3326f310aaee73f3e515b1ce84"
server_key_iv: "52f2aeb8ad81afe13a7839b8fb38cb4d"
server_key_version: "encryptionkey@0"
I20260811 01:36:46.754578 16048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "38c755b1d5d2453d8e0630318ca79315"
format_stamp: "Formatted at 2026-08-11 01:36:46 on dist-test-slave-9jjr"
server_key: "7cf8ac3326f310aaee73f3e515b1ce84"
server_key_iv: "52f2aeb8ad81afe13a7839b8fb38cb4d"
server_key_version: "encryptionkey@0"
I20260811 01:36:46.759932 16048 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260811 01:36:46.763590 16063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:46.765041 16048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:46.765245 16048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "38c755b1d5d2453d8e0630318ca79315"
format_stamp: "Formatted at 2026-08-11 01:36:46 on dist-test-slave-9jjr"
server_key: "7cf8ac3326f310aaee73f3e515b1ce84"
server_key_iv: "52f2aeb8ad81afe13a7839b8fb38cb4d"
server_key_version: "encryptionkey@0"
I20260811 01:36:46.765463 16048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:46.791553 16048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:46.796188 16048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:46.796545 16048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:46.817200 16048 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:40825
I20260811 01:36:46.817219 16121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:40825 every 8 connection(s)
I20260811 01:36:46.818710 16048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:46.822374 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16048
I20260811 01:36:46.822585 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:46.823057 16122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:46.823208 23711 external_mini_cluster.cc:1428] Setting key 56d286190cd93a80c459d9cf3f9be4ae
I20260811 01:36:46.837728 16122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315: Bootstrap starting.
I20260811 01:36:46.837976 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:46.825068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41627 (local address 127.23.39.254:40825)
0811 01:36:46.825907 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:46.825919 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:46.825971 (+ 52us) server_negotiation.cc:407] Connection header received
0811 01:36:46.828029 (+ 2058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:46.828051 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:46.828470 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:46.828801 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:46.829481 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:46.830929 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:46.832732 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:46.833422 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:46.833557 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:46.835109 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:46.835135 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:46.835153 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:46.835789 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:46.835885 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:46.835911 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:46.836045 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:46.836417 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 01:36:46.836622 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":385,"threads_started":1}
I20260811 01:36:46.841840 16122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:46.842648 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:46.843187 16122 log.cc:824] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:46.846504 16122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315: No bootstrap required, opened a new log
I20260811 01:36:46.855522 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:46.847922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34747 (local address 127.23.39.254:40825)
0811 01:36:46.848127 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:46.848133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:46.848710 (+ 577us) server_negotiation.cc:407] Connection header received
0811 01:36:46.848894 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:46.848898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:46.848973 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:46.849067 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:46.849702 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:46.850581 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:46.852528 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:46.853029 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:46.853134 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:46.854454 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:46.854459 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:46.854462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:46.854484 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:46.854543 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:46.854562 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:46.854656 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:46.854872 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 01:36:46.854924 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 01:36:46.857126 16122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } }
I20260811 01:36:46.857640 16122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:46.857761 16122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c755b1d5d2453d8e0630318ca79315, State: Initialized, Role: FOLLOWER
I20260811 01:36:46.858444 16122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } }
I20260811 01:36:46.858705 16122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:46.858875 16122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:46.859055 16122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:46.861400 16122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } }
I20260811 01:36:46.862004 16122 leader_election.cc:302] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38c755b1d5d2453d8e0630318ca79315; no voters:
I20260811 01:36:46.862774 16122 leader_election.cc:288] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:46.862905 16132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:46.864410 16132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [term 1 LEADER]: Becoming Leader. State: Replica: 38c755b1d5d2453d8e0630318ca79315, State: Running, Role: LEADER
I20260811 01:36:46.865005 16132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } }
I20260811 01:36:46.865177 16122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:46.870220 16135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c755b1d5d2453d8e0630318ca79315. Latest consensus state: current_term: 1 leader_uuid: "38c755b1d5d2453d8e0630318ca79315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } } }
I20260811 01:36:46.870204 16133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38c755b1d5d2453d8e0630318ca79315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c755b1d5d2453d8e0630318ca79315" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 40825 } } }
I20260811 01:36:46.870944 16135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:46.871038 16133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:46.879437 16143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:46.884210 16143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:46.893200 16143 catalog_manager.cc:1347] Generated new cluster ID: d308dc63244d40d2b87d97a1febef02d
I20260811 01:36:46.893338 16143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:46.910897 16143 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:46.912912 16143 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:46.929912 16143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38c755b1d5d2453d8e0630318ca79315: Generated new TSK 0
I20260811 01:36:46.931033 16143 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:46.941612 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16048
W20260811 01:36:46.942972 16117 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41627
W20260811 01:36:46.943853 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16048: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:46.944020 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16048
W20260811 01:36:46.965281 16033 connection.cc:535] client connection to 127.23.39.254:40825 recv error: Network error: failed to read from TLS socket (remote: 127.23.39.254:40825): Connection reset by peer (error 104)
2026-08-11T01:36:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2185 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:47 dist-test-slave-9jjr krb5kdc[16155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:47 dist-test-slave-9jjr krb5kdc[16155](info): set up 2 sockets
Aug 11 01:36:47 dist-test-slave-9jjr krb5kdc[16155](info): commencing operation
krb5kdc: starting...
W20260811 01:36:48.187060 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.002s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:48 dist-test-slave-9jjr krb5kdc[16155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:48.553646 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34419
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:38901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:34419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:48.933719 16168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:48.934026 16168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:48.934119 16168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:48.941814 16168 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:48.941941 16168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:48.942044 16168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:48.942166 16168 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:48.942242 16168 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:48.952447 16168 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:38901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:34419
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:34419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:48.953855 16168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:48.955293 16168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:48.967561 16178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:48.967670 16175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:48.967635 16176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:48.968708 16168 server_base.cc:1034] running on GCE node
I20260811 01:36:48.969609 16168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:48.971163 16168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:48.972414 16168 hybrid_clock.cc:648] HybridClock initialized: now 1786412208972376 us; error 38 us; skew 500 ppm
I20260811 01:36:48.972796 16168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:48 dist-test-slave-9jjr krb5kdc[16155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412208, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:48.976080 16168 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:48.977725 16168 webserver.cc:460] Webserver started at http://127.23.39.254:38985/ using document root <none> and password file <none>
I20260811 01:36:48.978497 16168 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:48.978657 16168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:48.978981 16168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:48.982544 16168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "b01e6151e25d4beca23009844310959f"
format_stamp: "Formatted at 2026-08-11 01:36:48 on dist-test-slave-9jjr"
server_key: "42f40fc5a31d01fffec9776f9499c4dc"
server_key_iv: "32c19dcff7351c0d49a7bf29c5998cb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:48.983333 16168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "b01e6151e25d4beca23009844310959f"
format_stamp: "Formatted at 2026-08-11 01:36:48 on dist-test-slave-9jjr"
server_key: "42f40fc5a31d01fffec9776f9499c4dc"
server_key_iv: "32c19dcff7351c0d49a7bf29c5998cb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:48.988651 16168 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:36:48.992306 16185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:48.993769 16168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:48.993968 16168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "b01e6151e25d4beca23009844310959f"
format_stamp: "Formatted at 2026-08-11 01:36:48 on dist-test-slave-9jjr"
server_key: "42f40fc5a31d01fffec9776f9499c4dc"
server_key_iv: "32c19dcff7351c0d49a7bf29c5998cb0"
server_key_version: "encryptionkey@0"
I20260811 01:36:48.994204 16168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:48.999881 16168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:49.004112 16168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:49.004429 16168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:49.025588 16168 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:34419
I20260811 01:36:49.025610 16240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:34419 every 8 connection(s)
I20260811 01:36:49.027230 16168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:49.030587 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16168
I20260811 01:36:49.030778 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:49.031222 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:49.031260 23711 external_mini_cluster.cc:1428] Setting key 68de25ef89372bd5d4e35d45beb3eef6
I20260811 01:36:49.040565 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:49.033261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34651 (local address 127.23.39.254:34419)
0811 01:36:49.034140 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:49.034157 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:49.034214 (+ 57us) server_negotiation.cc:407] Connection header received
0811 01:36:49.036388 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:49.036418 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:49.036894 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:49.037378 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:49.038491 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:49.038499 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:49.038522 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:49.038540 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:49.038612 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:49.038642 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:49.038889 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:49.039030 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 01:36:49.039267 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":356,"threads_started":1}
I20260811 01:36:49.044773 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:49.047219 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f: Bootstrap starting.
I20260811 01:36:49.051432 16241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:49.052835 16241 log.cc:824] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:49.052837 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:49.050175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36587 (local address 127.23.39.254:34419)
0811 01:36:49.050431 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:49.050438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:49.050817 (+ 379us) server_negotiation.cc:407] Connection header received
0811 01:36:49.050985 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:49.050989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:49.051040 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:49.051120 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:49.052141 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:49.052145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:49.052148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:49.052162 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:49.052200 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:49.052214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:49.052325 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:49.052478 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 01:36:49.052524 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:36:49.055665 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f: No bootstrap required, opened a new log
I20260811 01:36:49.063576 16241 raft_consensus.cc:348] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } }
I20260811 01:36:49.063978 16241 raft_consensus.cc:374] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:49.064095 16241 raft_consensus.cc:729] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01e6151e25d4beca23009844310959f, State: Initialized, Role: FOLLOWER
I20260811 01:36:49.064658 16241 consensus_queue.cc:260] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } }
I20260811 01:36:49.064911 16241 raft_consensus.cc:388] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:49.065073 16241 raft_consensus.cc:482] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:49.065232 16241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:49.067850 16241 raft_consensus.cc:504] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } }
I20260811 01:36:49.068411 16241 leader_election.cc:302] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b01e6151e25d4beca23009844310959f; no voters:
I20260811 01:36:49.069041 16241 leader_election.cc:288] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:49.069206 16251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:49.069907 16251 raft_consensus.cc:686] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [term 1 LEADER]: Becoming Leader. State: Replica: b01e6151e25d4beca23009844310959f, State: Running, Role: LEADER
I20260811 01:36:49.070467 16251 consensus_queue.cc:237] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } }
I20260811 01:36:49.071165 16241 sys_catalog.cc:564] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:49.073596 16252 sys_catalog.cc:455] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b01e6151e25d4beca23009844310959f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } } }
I20260811 01:36:49.073488 16253 sys_catalog.cc:455] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b01e6151e25d4beca23009844310959f. Latest consensus state: current_term: 1 leader_uuid: "b01e6151e25d4beca23009844310959f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01e6151e25d4beca23009844310959f" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 34419 } } }
I20260811 01:36:49.074427 16252 sys_catalog.cc:458] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:49.074429 16253 sys_catalog.cc:458] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:49.079188 16258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:49.085289 16258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:49.094704 16258 catalog_manager.cc:1347] Generated new cluster ID: b1b2a8d866044da091be946cbe2311dc
I20260811 01:36:49.094837 16258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:49.133720 16258 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:49.134271 16258 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:49.142820 16258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b01e6151e25d4beca23009844310959f: Generated new TSK 0
I20260811 01:36:49.143731 16258 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:49.155838 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16168
W20260811 01:36:49.157101 16235 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34651
W20260811 01:36:49.157912 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16168: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:49.158082 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16168
2026-08-11T01:36:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2214 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:49 dist-test-slave-9jjr krb5kdc[16275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:49 dist-test-slave-9jjr krb5kdc[16275](info): set up 2 sockets
Aug 11 01:36:49 dist-test-slave-9jjr krb5kdc[16275](info): commencing operation
krb5kdc: starting...
W20260811 01:36:50.396533 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:50 dist-test-slave-9jjr krb5kdc[16275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412210, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:50.774490 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:41187
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:41187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:51.132270 16289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:51.132575 16289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:51.132750 16289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:51.140225 16289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:51.140349 16289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:51.140461 16289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:51.140571 16289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:51.140655 16289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:51.151033 16289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:41187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:41187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:51.152473 16289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:51.153867 16289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:51.166448 16295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:51.166471 16294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:51.166501 16297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:51.167799 16289 server_base.cc:1034] running on GCE node
I20260811 01:36:51.168701 16289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:51.170295 16289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:51.171550 16289 hybrid_clock.cc:648] HybridClock initialized: now 1786412211171506 us; error 47 us; skew 500 ppm
I20260811 01:36:51.171932 16289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:51 dist-test-slave-9jjr krb5kdc[16275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412211, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:51.181386 16289 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:51.183382 16289 webserver.cc:460] Webserver started at http://127.23.39.254:38985/ using document root <none> and password file <none>
I20260811 01:36:51.184198 16289 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:51.184377 16289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:51.184732 16289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:51.188259 16289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "d9f3dafd7468451daec19429ca220a64"
format_stamp: "Formatted at 2026-08-11 01:36:51 on dist-test-slave-9jjr"
server_key: "19270f4907717a5d35ef96f6b747275b"
server_key_iv: "f4c4e2650c05a3346e289bf28a2478bc"
server_key_version: "encryptionkey@0"
I20260811 01:36:51.189157 16289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "d9f3dafd7468451daec19429ca220a64"
format_stamp: "Formatted at 2026-08-11 01:36:51 on dist-test-slave-9jjr"
server_key: "19270f4907717a5d35ef96f6b747275b"
server_key_iv: "f4c4e2650c05a3346e289bf28a2478bc"
server_key_version: "encryptionkey@0"
I20260811 01:36:51.195024 16289 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260811 01:36:51.198778 16304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:51.200259 16289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:51.200409 16289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "d9f3dafd7468451daec19429ca220a64"
format_stamp: "Formatted at 2026-08-11 01:36:51 on dist-test-slave-9jjr"
server_key: "19270f4907717a5d35ef96f6b747275b"
server_key_iv: "f4c4e2650c05a3346e289bf28a2478bc"
server_key_version: "encryptionkey@0"
I20260811 01:36:51.200587 16289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:51.232165 16289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:51.236580 16289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:51.236836 16289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:51.256168 16289 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:41187
I20260811 01:36:51.256196 16360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:41187 every 8 connection(s)
I20260811 01:36:51.257651 16289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:51.261895 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16289
I20260811 01:36:51.262089 16361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:51.262115 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:51.262742 23711 external_mini_cluster.cc:1428] Setting key 330d25632d5b50771fc5bcdc9d6d0d71
I20260811 01:36:51.278898 16361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64: Bootstrap starting.
Aug 11 01:36:51 dist-test-slave-9jjr krb5kdc[16275](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412210, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:51.282466 16361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:51.283655 16361 log.cc:824] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:51.286871 16361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64: No bootstrap required, opened a new log
I20260811 01:36:51.288630 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:51.264803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56803 (local address 127.23.39.254:41187)
0811 01:36:51.265739 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:51.265755 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:51.265800 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:36:51.267471 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:51.267496 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:51.267951 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:51.268322 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:51.270457 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:51.271814 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:51.273771 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:51.274673 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:51.274828 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:51.280515 (+ 5687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:51.280525 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:51.280540 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:51.280596 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:51.284152 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:51.285003 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:51.285011 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:51.285018 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:51.285214 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:51.285660 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:51.285666 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:51.285669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:51.286337 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:51.286648 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:51.287123 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 01:36:51.287608 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":449,"threads_started":1}
I20260811 01:36:51.292825 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:51.295926 16361 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } }
I20260811 01:36:51.296347 16361 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:51.296476 16361 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f3dafd7468451daec19429ca220a64, State: Initialized, Role: FOLLOWER
I20260811 01:36:51.297195 16361 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } }
I20260811 01:36:51.297546 16361 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:51.297793 16361 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:51.298039 16361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:51.300518 16361 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } }
I20260811 01:36:51.301103 16361 leader_election.cc:302] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9f3dafd7468451daec19429ca220a64; no voters:
I20260811 01:36:51.301828 16361 leader_election.cc:288] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:51.301940 16372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:51.304785 16361 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:51.306465 16372 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [term 1 LEADER]: Becoming Leader. State: Replica: d9f3dafd7468451daec19429ca220a64, State: Running, Role: LEADER
I20260811 01:36:51.307487 16372 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } }
I20260811 01:36:51.311273 16373 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9f3dafd7468451daec19429ca220a64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } } }
I20260811 01:36:51.311911 16373 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:51.312808 16374 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9f3dafd7468451daec19429ca220a64. Latest consensus state: current_term: 1 leader_uuid: "d9f3dafd7468451daec19429ca220a64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f3dafd7468451daec19429ca220a64" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 41187 } } }
I20260811 01:36:51.313681 16374 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:51.316118 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:51.297554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42591 (local address 127.23.39.254:41187)
0811 01:36:51.297761 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:51.297765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:51.298435 (+ 670us) server_negotiation.cc:407] Connection header received
0811 01:36:51.298654 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:51.298659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:51.298754 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:51.298876 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:51.300486 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:51.301413 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:51.303159 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:51.303656 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:51.303823 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:51.306859 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:51.306864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:51.306867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:51.306940 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:51.310570 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:51.311618 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:51.311622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:51.311626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:51.311788 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:51.312339 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:51.312344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:51.312347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:51.312778 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:51.315002 (+ 2224us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:51.315217 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 01:36:51.315549 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 01:36:51.321149 16378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:51.328299 16378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:51.337493 16378 catalog_manager.cc:1347] Generated new cluster ID: 282e64fdfffe4f728aa409b97a493df0
I20260811 01:36:51.337625 16378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:51.367223 16378 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:51.369529 16378 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:51.380005 16378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9f3dafd7468451daec19429ca220a64: Generated new TSK 0
I20260811 01:36:51.381363 16378 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:51.393229 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16289
I20260811 01:36:51.395785 16354 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:36:51.503243 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16289
2026-08-11T01:36:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2344 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:51 dist-test-slave-9jjr krb5kdc[16398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:51 dist-test-slave-9jjr krb5kdc[16398](info): set up 2 sockets
Aug 11 01:36:51 dist-test-slave-9jjr krb5kdc[16398](info): commencing operation
krb5kdc: starting...
W20260811 01:36:52.733660 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.004s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:52 dist-test-slave-9jjr krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:53.115620 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36069
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:44491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:36069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:53.484887 16413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:53.485296 16413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:53.485481 16413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:53.493100 16413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:53.493292 16413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:53.493417 16413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:53.493538 16413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:53.493623 16413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:53.504339 16413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:44491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:36069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:36069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:53.505822 16413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:53.507256 16413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:53.520551 16423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:53.520629 16420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:53.520660 16419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:53.521677 16413 server_base.cc:1034] running on GCE node
I20260811 01:36:53.522708 16413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:53.524364 16413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:53.525585 16413 hybrid_clock.cc:648] HybridClock initialized: now 1786412213525535 us; error 44 us; skew 500 ppm
I20260811 01:36:53.525961 16413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:53 dist-test-slave-9jjr krb5kdc[16398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412213, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:53.529443 16413 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:53.531224 16413 webserver.cc:460] Webserver started at http://127.23.39.254:42907/ using document root <none> and password file <none>
I20260811 01:36:53.531966 16413 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:53.532123 16413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:53.532455 16413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:53.535728 16413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "40afe7c3bba54cdea388f531a08b2815"
format_stamp: "Formatted at 2026-08-11 01:36:53 on dist-test-slave-9jjr"
server_key: "2b3b6bd8d1b66cab20c75d8e74b518c5"
server_key_iv: "4a3d02c2641de13278f0ea2c90ced6a9"
server_key_version: "encryptionkey@0"
I20260811 01:36:53.536569 16413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "40afe7c3bba54cdea388f531a08b2815"
format_stamp: "Formatted at 2026-08-11 01:36:53 on dist-test-slave-9jjr"
server_key: "2b3b6bd8d1b66cab20c75d8e74b518c5"
server_key_iv: "4a3d02c2641de13278f0ea2c90ced6a9"
server_key_version: "encryptionkey@0"
I20260811 01:36:53.542536 16413 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260811 01:36:53.546686 16430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:53.548388 16413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 01:36:53.548620 16413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "40afe7c3bba54cdea388f531a08b2815"
format_stamp: "Formatted at 2026-08-11 01:36:53 on dist-test-slave-9jjr"
server_key: "2b3b6bd8d1b66cab20c75d8e74b518c5"
server_key_iv: "4a3d02c2641de13278f0ea2c90ced6a9"
server_key_version: "encryptionkey@0"
I20260811 01:36:53.548866 16413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:53.576859 16413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:53.581995 16413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:53.582368 16413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:53.602957 16413 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:36069
I20260811 01:36:53.603001 16487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:36069 every 8 connection(s)
I20260811 01:36:53.604487 16413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:53.605728 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16413
I20260811 01:36:53.605935 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:53.606537 23711 external_mini_cluster.cc:1428] Setting key 011141f2fb9c46810aed77a45e9f32ef
I20260811 01:36:53.609700 16488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:53.621872 16491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:53.608645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46671 (local address 127.23.39.254:36069)
0811 01:36:53.609678 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:53.609697 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:53.609747 (+ 50us) server_negotiation.cc:407] Connection header received
0811 01:36:53.611858 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:53.611883 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:53.612334 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:53.612811 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:53.613455 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:53.615076 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:53.616604 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:53.617381 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:53.617606 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:53.619126 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:53.619135 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:53.619151 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:53.619836 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:53.619932 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:53.619961 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:53.620114 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:53.620417 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 01:36:53.620737 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":463,"threads_started":1}
I20260811 01:36:53.622807 16488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815: Bootstrap starting.
I20260811 01:36:53.626471 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:53.626884 16488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:53.628054 16488 log.cc:824] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:53.632020 16488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815: No bootstrap required, opened a new log
I20260811 01:36:53.638793 16491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:53.631757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34997 (local address 127.23.39.254:36069)
0811 01:36:53.631973 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:53.631983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:53.632524 (+ 541us) server_negotiation.cc:407] Connection header received
0811 01:36:53.632880 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:53.632886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:53.632992 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:53.633113 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:53.633834 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:53.634694 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:53.636101 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:53.636589 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:53.636736 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:53.637952 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:53.637958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:53.637961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:53.637984 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:53.638027 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:53.638044 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:53.638173 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:53.638334 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 01:36:53.638438 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 01:36:53.641844 16488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } }
I20260811 01:36:53.642510 16488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:53.642648 16488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40afe7c3bba54cdea388f531a08b2815, State: Initialized, Role: FOLLOWER
I20260811 01:36:53.643388 16488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } }
I20260811 01:36:53.643682 16488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:53.643790 16488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:53.643945 16488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:53.646648 16488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } }
I20260811 01:36:53.647290 16488 leader_election.cc:302] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40afe7c3bba54cdea388f531a08b2815; no voters:
I20260811 01:36:53.647935 16488 leader_election.cc:288] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:53.648123 16499 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:53.649809 16499 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [term 1 LEADER]: Becoming Leader. State: Replica: 40afe7c3bba54cdea388f531a08b2815, State: Running, Role: LEADER
I20260811 01:36:53.650635 16488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:53.650602 16499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } }
I20260811 01:36:53.653892 16501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40afe7c3bba54cdea388f531a08b2815. Latest consensus state: current_term: 1 leader_uuid: "40afe7c3bba54cdea388f531a08b2815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } } }
I20260811 01:36:53.654627 16501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:53.654511 16500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40afe7c3bba54cdea388f531a08b2815" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40afe7c3bba54cdea388f531a08b2815" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 36069 } } }
I20260811 01:36:53.654942 16500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:53.658298 16509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:53.663470 16509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:53.673709 16509 catalog_manager.cc:1347] Generated new cluster ID: 1b41db5b53fa416099854b23617a3f8b
I20260811 01:36:53.673857 16509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:53.696377 16509 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:53.698680 16509 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:53.707096 16509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40afe7c3bba54cdea388f531a08b2815: Generated new TSK 0
I20260811 01:36:53.708154 16509 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:53.719655 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16413
W20260811 01:36:53.721571 16483 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46671
W20260811 01:36:53.722415 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16413: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:53.722623 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16413
2026-08-11T01:36:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:53 dist-test-slave-9jjr krb5kdc[16521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:53 dist-test-slave-9jjr krb5kdc[16521](info): set up 2 sockets
Aug 11 01:36:53 dist-test-slave-9jjr krb5kdc[16521](info): commencing operation
krb5kdc: starting...
W20260811 01:36:54.980105 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:55 dist-test-slave-9jjr krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:55.358522 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39049
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:36533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:55.724663 16534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:55.724994 16534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:55.725168 16534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:55.734264 16534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:55.734395 16534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:55.734473 16534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:55.734596 16534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:55.734650 16534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:55.745297 16534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:36533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:55.746755 16534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:55.748178 16534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:55.761400 16539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:55.761410 16542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:55.761453 16540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:55.762091 16534 server_base.cc:1034] running on GCE node
I20260811 01:36:55.763253 16534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:55.765018 16534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:55.766321 16534 hybrid_clock.cc:648] HybridClock initialized: now 1786412215766270 us; error 75 us; skew 500 ppm
I20260811 01:36:55.766762 16534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:55 dist-test-slave-9jjr krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412215, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:55.770529 16534 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:55.772262 16534 webserver.cc:460] Webserver started at http://127.23.39.254:37117/ using document root <none> and password file <none>
I20260811 01:36:55.772990 16534 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:55.773102 16534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:55.773422 16534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:55.776978 16534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "c03f407a719b41f480b9d566fb408b59"
format_stamp: "Formatted at 2026-08-11 01:36:55 on dist-test-slave-9jjr"
server_key: "3720dc10fdde9db709f2d9bc056936b5"
server_key_iv: "2e1670f6edff66a0ceb33f2ecf58654d"
server_key_version: "encryptionkey@0"
I20260811 01:36:55.777787 16534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "c03f407a719b41f480b9d566fb408b59"
format_stamp: "Formatted at 2026-08-11 01:36:55 on dist-test-slave-9jjr"
server_key: "3720dc10fdde9db709f2d9bc056936b5"
server_key_iv: "2e1670f6edff66a0ceb33f2ecf58654d"
server_key_version: "encryptionkey@0"
I20260811 01:36:55.783632 16534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 01:36:55.787529 16550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:55.789160 16534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:36:55.789336 16534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "c03f407a719b41f480b9d566fb408b59"
format_stamp: "Formatted at 2026-08-11 01:36:55 on dist-test-slave-9jjr"
server_key: "3720dc10fdde9db709f2d9bc056936b5"
server_key_iv: "2e1670f6edff66a0ceb33f2ecf58654d"
server_key_version: "encryptionkey@0"
I20260811 01:36:55.789539 16534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:55.795849 16534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:55.800347 16534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:55.800632 16534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:55.821448 16534 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39049
I20260811 01:36:55.821492 16608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39049 every 8 connection(s)
I20260811 01:36:55.823025 16534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:55.826413 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16534
I20260811 01:36:55.826611 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:55.827204 23711 external_mini_cluster.cc:1428] Setting key 1d0af63ad7f4b79d23d8f3962f431c9f
I20260811 01:36:55.827349 16609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:55.835758 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:55.829105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48813 (local address 127.23.39.254:39049)
0811 01:36:55.829952 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:55.829963 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:55.830008 (+ 45us) server_negotiation.cc:407] Connection header received
0811 01:36:55.832110 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:55.832132 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:55.832485 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:55.832845 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:55.834049 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:55.834056 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:55.834069 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:55.834088 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:55.834211 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:55.834251 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:55.834436 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:55.834548 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 01:36:55.834767 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":372,"threads_started":1}
I20260811 01:36:55.839717 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:55.842248 16609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59: Bootstrap starting.
I20260811 01:36:55.846832 16609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:55.848289 16612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:55.845340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55637 (local address 127.23.39.254:39049)
0811 01:36:55.845594 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:55.845600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:55.846011 (+ 411us) server_negotiation.cc:407] Connection header received
0811 01:36:55.846271 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:55.846276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:55.846328 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:55.846417 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:55.847572 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:55.847576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:55.847580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 01:36:55.847599 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:55.847642 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 01:36:55.847659 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:55.847757 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:55.847904 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 01:36:55.847956 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 01:36:55.848464 16609 log.cc:824] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:55.851842 16609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59: No bootstrap required, opened a new log
I20260811 01:36:55.860533 16609 raft_consensus.cc:348] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } }
I20260811 01:36:55.861059 16609 raft_consensus.cc:374] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 01:36:55.861192 16609 raft_consensus.cc:729] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03f407a719b41f480b9d566fb408b59, State: Initialized, Role: FOLLOWER
I20260811 01:36:55.861961 16609 consensus_queue.cc:260] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } }
I20260811 01:36:55.862294 16609 raft_consensus.cc:388] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 01:36:55.862414 16609 raft_consensus.cc:482] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 01:36:55.862545 16609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:55.864907 16609 raft_consensus.cc:504] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } }
I20260811 01:36:55.865454 16609 leader_election.cc:302] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c03f407a719b41f480b9d566fb408b59; no voters:
I20260811 01:36:55.866192 16609 leader_election.cc:288] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 01:36:55.866410 16621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:55.867151 16621 raft_consensus.cc:686] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [term 1 LEADER]: Becoming Leader. State: Replica: c03f407a719b41f480b9d566fb408b59, State: Running, Role: LEADER
I20260811 01:36:55.867755 16621 consensus_queue.cc:237] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } }
I20260811 01:36:55.868645 16609 sys_catalog.cc:564] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:55.870617 16624 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c03f407a719b41f480b9d566fb408b59. Latest consensus state: current_term: 1 leader_uuid: "c03f407a719b41f480b9d566fb408b59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } } }
I20260811 01:36:55.871047 16624 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:55.871709 16622 sys_catalog.cc:455] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c03f407a719b41f480b9d566fb408b59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c03f407a719b41f480b9d566fb408b59" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39049 } } }
I20260811 01:36:55.872015 16622 sys_catalog.cc:458] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:55.875401 16631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:55.882120 16631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:55.894593 16631 catalog_manager.cc:1347] Generated new cluster ID: 70112716f3b74c9fbd67c56c9cef6679
I20260811 01:36:55.894912 16631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:55.910849 16631 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:55.911427 16631 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:55.926873 16631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c03f407a719b41f480b9d566fb408b59: Generated new TSK 0
I20260811 01:36:55.928085 16631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:55.942749 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16534
W20260811 01:36:55.944145 16604 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48813
W20260811 01:36:55.945013 23711 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16534: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260811 01:36:55.945188 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16534
2026-08-11T01:36:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2221 ms)
[----------] 18 tests from AuthTokenIssuingTest (39892 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:36:56 dist-test-slave-9jjr krb5kdc[16645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:36:56 dist-test-slave-9jjr krb5kdc[16645](info): set up 2 sockets
Aug 11 01:36:56 dist-test-slave-9jjr krb5kdc[16645](info): commencing operation
krb5kdc: starting...
W20260811 01:36:57.163502 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.001s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:36:57 dist-test-slave-9jjr krb5kdc[16645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:36:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:36:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:36:57.538571 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39063
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:36:57.904165 16658 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:36:57.904533 16658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:57.904600 16658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:57.904693 16658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:57.912372 16658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:57.912494 16658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:57.912554 16658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:57.912600 16658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:57.912683 16658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:57.923166 16658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:39063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:57.924556 16658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:57.925889 16658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:57.938894 16663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:57.938995 16664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:57.938969 16666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:57.939778 16658 server_base.cc:1034] running on GCE node
I20260811 01:36:57.940622 16658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:57.942207 16658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:57.943531 16658 hybrid_clock.cc:648] HybridClock initialized: now 1786412217943441 us; error 54 us; skew 500 ppm
I20260811 01:36:57.943945 16658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:57 dist-test-slave-9jjr krb5kdc[16645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:57.950944 16658 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:36:57.952885 16658 webserver.cc:460] Webserver started at http://127.23.39.254:44741/ using document root <none> and password file <none>
I20260811 01:36:57.953687 16658 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:57.953832 16658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:57.954576 16658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:57.958019 16658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "06570a3bf78442219f68a43be9845a47"
format_stamp: "Formatted at 2026-08-11 01:36:57 on dist-test-slave-9jjr"
server_key: "cba13ba0d2cac3c9d9b0d48598cea4d7"
server_key_iv: "1f282a53af9314ede6067cd7a4205659"
server_key_version: "encryptionkey@0"
I20260811 01:36:57.959041 16658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "06570a3bf78442219f68a43be9845a47"
format_stamp: "Formatted at 2026-08-11 01:36:57 on dist-test-slave-9jjr"
server_key: "cba13ba0d2cac3c9d9b0d48598cea4d7"
server_key_iv: "1f282a53af9314ede6067cd7a4205659"
server_key_version: "encryptionkey@0"
I20260811 01:36:57.965013 16658 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 01:36:57.968797 16674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:57.970360 16658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:36:57.970567 16658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "06570a3bf78442219f68a43be9845a47"
format_stamp: "Formatted at 2026-08-11 01:36:57 on dist-test-slave-9jjr"
server_key: "cba13ba0d2cac3c9d9b0d48598cea4d7"
server_key_iv: "1f282a53af9314ede6067cd7a4205659"
server_key_version: "encryptionkey@0"
I20260811 01:36:57.970824 16658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:57.986855 16658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:57.991453 16658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:57.991755 16658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:58.012547 16658 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:39063
I20260811 01:36:58.012565 16729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:39063 every 8 connection(s)
I20260811 01:36:58.014046 16658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:36:58.016338 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16658
I20260811 01:36:58.016601 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:36:58.017594 23711 external_mini_cluster.cc:1428] Setting key e18b118af8e0e9e3f39afeafb2e48efd
I20260811 01:36:58.019487 16730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:58.031160 16730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:36:58 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.39.253@KRBTEST.COM; defaulting to no policy
I20260811 01:36:58.059142 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.035867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39063 (local address 127.0.0.1:34280)
0811 01:36:58.036861 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.036909 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:58.039064 (+ 2155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:58.039971 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:58.039978 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:58.040731 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:58.041066 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.041090 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.042770 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.042776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.043880 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.043893 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.044840 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.044847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.045025 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.045730 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:58.045753 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:58.048507 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:58.054290 (+ 5783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.054302 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.054314 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.054786 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.055372 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.055376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.055378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.055544 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.056795 (+ 1251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:58.056804 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:58.057062 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 01:36:58.057281 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 01:36:58.057712 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":464,"threads_started":1}
I20260811 01:36:58.059221 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.035868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.23.39.254:39063)
0811 01:36:58.037685 (+ 1817us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:58.037698 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:58.037752 (+ 54us) server_negotiation.cc:407] Connection header received
0811 01:36:58.039467 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:58.039472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:58.039733 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:58.039945 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:58.041296 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.042606 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.044028 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.044586 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.044791 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.048811 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:58.048826 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:58.048847 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:58.048897 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:58.054029 (+ 5132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.054959 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.054971 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.054976 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.055232 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.055692 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.055699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.055706 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.056600 (+ 894us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:58.056879 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:58.057472 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 01:36:58.057964 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":1600,"thread_start_us":1373,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.253@KRBTEST.COM" created.
I20260811 01:36:58.062777 16730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:36:58.064066 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.063625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46440)
0811 01:36:58.063829 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.063947 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260811 01:36:58.064487 16676 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
I20260811 01:36:58.066308 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.065827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46448)
0811 01:36:58.065994 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.066074 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:36:58.066668 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35841: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
I20260811 01:36:58.101085 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:35841
--webserver_interface=127.23.39.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:36:58.116098 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } attempt: 1
I20260811 01:36:58.117558 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.116943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46460)
0811 01:36:58.117201 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.117352 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 01:36:58.118878 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.118382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46466)
0811 01:36:58.118565 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.118687 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 01:36:58.119159 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35841: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
I20260811 01:36:58.187439 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } attempt: 2
I20260811 01:36:58.188814 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.188153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46478)
0811 01:36:58.188461 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.188599 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 01:36:58.190032 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.189561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46486)
0811 01:36:58.189757 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.189872 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 01:36:58.190311 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35841: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
I20260811 01:36:58.281625 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } attempt: 3
I20260811 01:36:58.283002 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.282458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46500)
0811 01:36:58.282695 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.282827 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:36:58.284173 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.283743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46512)
0811 01:36:58.283928 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.283999 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260811 01:36:58.284473 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35841: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
I20260811 01:36:58.427793 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } attempt: 4
I20260811 01:36:58.429409 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.428741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46520)
0811 01:36:58.429093 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.429243 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
I20260811 01:36:58.430739 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.430346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46530)
0811 01:36:58.430510 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.430593 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:36:58.430989 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35841: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35841: connect: Connection refused (error 111)
W20260811 01:36:58.459636 16737 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:36:58.460004 16737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:58.460121 16737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:58.460228 16737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:58.467833 16737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:58.468009 16737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:58.468111 16737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:58.468204 16737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:58.468294 16737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:58.478797 16737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:35841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.39.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:58.480085 16737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:58.481354 16737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:58.494148 16743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:58.494325 16742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:58.494710 16745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:58.495672 16737 server_base.cc:1034] running on GCE node
I20260811 01:36:58.496549 16737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:58.498100 16737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:58.499414 16737 hybrid_clock.cc:648] HybridClock initialized: now 1786412218499350 us; error 49 us; skew 500 ppm
I20260811 01:36:58.499809 16737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:58 dist-test-slave-9jjr krb5kdc[16645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412218, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:58.503516 16737 init.cc:377] Logged in from keytab as kudu/127.23.39.253@KRBTEST.COM (short username kudu)
I20260811 01:36:58.505175 16737 webserver.cc:460] Webserver started at http://127.23.39.253:43247/ using document root <none> and password file <none>
I20260811 01:36:58.505939 16737 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:58.506088 16737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:58.506469 16737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:58.509725 16737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data/instance:
uuid: "fd95af01d0304ea3a53ae768735f01ed"
format_stamp: "Formatted at 2026-08-11 01:36:58 on dist-test-slave-9jjr"
server_key: "af5b27845a43e50ae3e1054a56d0fb91"
server_key_iv: "5e72596a4107dfed2cc32b6ad9f4f06a"
server_key_version: "encryptionkey@0"
I20260811 01:36:58.510653 16737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal/instance:
uuid: "fd95af01d0304ea3a53ae768735f01ed"
format_stamp: "Formatted at 2026-08-11 01:36:58 on dist-test-slave-9jjr"
server_key: "af5b27845a43e50ae3e1054a56d0fb91"
server_key_iv: "5e72596a4107dfed2cc32b6ad9f4f06a"
server_key_version: "encryptionkey@0"
I20260811 01:36:58.516475 16737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 01:36:58.520491 16752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:58.522079 16737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:36:58.522418 16737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "fd95af01d0304ea3a53ae768735f01ed"
format_stamp: "Formatted at 2026-08-11 01:36:58 on dist-test-slave-9jjr"
server_key: "af5b27845a43e50ae3e1054a56d0fb91"
server_key_iv: "5e72596a4107dfed2cc32b6ad9f4f06a"
server_key_version: "encryptionkey@0"
I20260811 01:36:58.522698 16737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:58.553134 16737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:58.558480 16737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:58.558809 16737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:58.580786 16737 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.253:35841
I20260811 01:36:58.580809 16808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.253:35841 every 8 connection(s)
I20260811 01:36:58.582489 16737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
I20260811 01:36:58.586479 16809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:58.589926 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16737
I20260811 01:36:58.590180 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-1/wal/instance
I20260811 01:36:58.590667 23711 external_mini_cluster.cc:1428] Setting key 85710dae7069cf20c9cb2f607cfad1bb
I20260811 01:36:58.593607 16809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:36:58 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412218, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:58.616611 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.596526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34286 (local address 127.23.39.254:39063)
0811 01:36:58.597094 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:58.597101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:58.598533 (+ 1432us) server_negotiation.cc:407] Connection header received
0811 01:36:58.600526 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:58.600532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:58.600634 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:58.600762 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:58.602443 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.603244 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.604823 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.605270 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.605411 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.609677 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:58.609684 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:58.609688 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:58.609747 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:58.612973 (+ 3226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.613892 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.613897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.613899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.614035 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.614579 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.614589 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.614591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.614913 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:58.615107 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:58.615914 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 01:36:58.616183 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":857,"threads_started":1}
I20260811 01:36:58.617669 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.597169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39063 (local address 127.0.0.1:34286)
0811 01:36:58.598359 (+ 1190us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.598399 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:58.600238 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:58.601031 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:58.601039 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:58.601578 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:58.602227 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.602246 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.603423 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.603428 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.604654 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.604667 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.605517 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.605524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.605763 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.606574 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:58.606600 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:58.609393 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:58.613161 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.613171 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.613192 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.613728 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.614202 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.614207 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.614211 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.614434 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.615065 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:58.615074 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:58.615492 (+ 418us) client_negotiation.cc:769] Sending connection context
0811 01:36:58.615801 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 01:36:58.616403 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":461,"threads_started":1}
I20260811 01:36:58.620007 16809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.39.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.252@KRBTEST.COM" created.
Aug 11 01:36:58 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412218, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:36:58.638806 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.620993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46534)
0811 01:36:58.621236 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.621259 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:58.621396 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:58.622588 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:58.622596 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:58.623164 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:58.623375 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.623391 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.624969 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.624974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.626040 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.626054 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.627161 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.627166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.627377 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.628045 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:58.628068 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:58.630823 (+ 2755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:58.635925 (+ 5102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.635930 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.635933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.636374 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.636906 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.636910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.636913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.637076 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.637934 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:58.637938 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:58.638083 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 01:36:58.638275 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 01:36:58.638519 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 01:36:58.639307 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.621239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46534 (local address 127.23.39.253:35841)
0811 01:36:58.622035 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:58.622041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:58.622078 (+ 37us) server_negotiation.cc:407] Connection header received
0811 01:36:58.622171 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:58.622182 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:58.622404 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:58.622539 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:58.623585 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.624809 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.626305 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.627011 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.627145 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.631108 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:58.631130 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:58.631154 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:58.631204 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:58.635711 (+ 4507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.636542 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.636553 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.636559 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.636736 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.637194 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.637201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.637206 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.637764 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:58.638015 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:58.638458 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 01:36:58.638778 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":454,"threads_started":1}
I20260811 01:36:58.641927 16809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:36:58.643313 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.642663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50958)
0811 01:36:58.642873 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.643080 (+ 207us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 01:36:58.643631 16754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.645480 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.644995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50960)
0811 01:36:58.645201 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.645327 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:36:58.645750 16809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
I20260811 01:36:58.675992 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:44939
--webserver_interface=127.23.39.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:34431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:36:58.695176 16809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 1
I20260811 01:36:58.696501 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.695978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50970)
0811 01:36:58.696206 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.696332 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 01:36:58.697695 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.697290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50986)
0811 01:36:58.697483 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.697563 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:36:58.697940 16809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.730289 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } attempt: 5
Aug 11 01:36:58 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:36:58.747605 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.731135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46538)
0811 01:36:58.731351 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.731411 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:58.731529 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:58.731959 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:58.731962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:58.732431 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:58.732628 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.732638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.734113 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.734117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.735087 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:58.735100 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.736096 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.736100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:58.736290 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.736996 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:58.737026 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:58.740037 (+ 3011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:58.744949 (+ 4912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.744957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.744963 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.745422 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.745908 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:58.745913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:58.745915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:58.746069 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:58.746802 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:58.746805 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:58.746960 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 01:36:58.747081 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 01:36:58.747348 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:36:58.747776 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.731232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.23.39.253:35841)
0811 01:36:58.731455 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:58.731461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:58.731487 (+ 26us) server_negotiation.cc:407] Connection header received
0811 01:36:58.731674 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:58.731681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:58.731784 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:58.731906 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:58.732817 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.733939 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.735241 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:58.735936 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:58.736076 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:58.740393 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:58.740401 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:58.740407 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:58.740454 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:58.744715 (+ 4261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.745565 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.745571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.745576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.745752 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:58.746236 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:58.746241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:58.746244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:58.746675 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:58.746838 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:58.747221 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 01:36:58.747463 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 01:36:58.748721 16730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:36:58.749749 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.749355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50988)
0811 01:36:58.749522 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.749607 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 01:36:58.750739 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.750422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:50994)
0811 01:36:58.750555 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.750623 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 01:36:58.750944 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.766283 16809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 2
I20260811 01:36:58.767514 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.767005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51006)
0811 01:36:58.767234 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.767344 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:36:58.768669 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.768271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51008)
0811 01:36:58.768461 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.768533 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 01:36:58.768893 16809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.802270 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 1
I20260811 01:36:58.803643 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.803087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51018)
0811 01:36:58.803322 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.803443 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 01:36:58.804760 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.804366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51030)
0811 01:36:58.804543 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.804637 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 01:36:58.805019 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.860184 16809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 3
I20260811 01:36:58.861563 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.861037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51044)
0811 01:36:58.861293 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.861389 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 01:36:58.862890 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.862415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51056)
0811 01:36:58.862683 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.862767 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260811 01:36:58.863144 16809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.873260 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 2
I20260811 01:36:58.874644 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.874012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51070)
0811 01:36:58.874346 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.874457 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260811 01:36:58.875715 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.875311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51078)
0811 01:36:58.875467 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.875551 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:36:58.876281 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:58.982577 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 3
I20260811 01:36:58.983860 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.983349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51084)
0811 01:36:58.983581 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.983686 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 01:36:58.984898 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:58.984533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51088)
0811 01:36:58.984717 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:58.984792 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 01:36:58.985097 16730 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
I20260811 01:36:59.006402 16809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 4
I20260811 01:36:59.007637 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.007116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51100)
0811 01:36:59.007366 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.007455 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 01:36:59.008836 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.008496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51116)
0811 01:36:59.008634 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.008717 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:36:59.009166 16809 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:44939: Network error: Client connection negotiation failed: client connection to 127.23.39.252:44939: connect: Connection refused (error 111)
W20260811 01:36:59.046455 16818 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:36:59.046851 16818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:36:59.046984 16818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:36:59.047118 16818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:36:59.054775 16818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:36:59.054889 16818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:36:59.054989 16818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:36:59.055092 16818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:36:59.055208 16818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:36:59.065907 16818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:34431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:39063,127.23.39.253:35841,127.23.39.252:44939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:44939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.39.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:36:59.067380 16818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:36:59.068792 16818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:36:59.081671 16823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:59.081791 16826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:36:59.081807 16824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:36:59.082881 16818 server_base.cc:1034] running on GCE node
I20260811 01:36:59.083866 16818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:36:59.085364 16818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:36:59.086609 16818 hybrid_clock.cc:648] HybridClock initialized: now 1786412219086536 us; error 70 us; skew 500 ppm
I20260811 01:36:59.086959 16818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412219, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:36:59.090456 16818 init.cc:377] Logged in from keytab as kudu/127.23.39.252@KRBTEST.COM (short username kudu)
I20260811 01:36:59.091995 16818 webserver.cc:460] Webserver started at http://127.23.39.252:46667/ using document root <none> and password file <none>
I20260811 01:36:59.092703 16818 fs_manager.cc:359] Metadata directory not provided
I20260811 01:36:59.092823 16818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:36:59.093169 16818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:36:59.096359 16818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data/instance:
uuid: "314a347151d24deeb22cdfd8cd276be5"
format_stamp: "Formatted at 2026-08-11 01:36:59 on dist-test-slave-9jjr"
server_key: "11d3565d3043fe34ecc44860bf11340f"
server_key_iv: "60ecbed0f45a9fcb26e26f746672a3c7"
server_key_version: "encryptionkey@0"
I20260811 01:36:59.097350 16818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal/instance:
uuid: "314a347151d24deeb22cdfd8cd276be5"
format_stamp: "Formatted at 2026-08-11 01:36:59 on dist-test-slave-9jjr"
server_key: "11d3565d3043fe34ecc44860bf11340f"
server_key_iv: "60ecbed0f45a9fcb26e26f746672a3c7"
server_key_version: "encryptionkey@0"
I20260811 01:36:59.103022 16818 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 01:36:59.106570 16833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:36:59.107954 16818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260811 01:36:59.108135 16818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "314a347151d24deeb22cdfd8cd276be5"
format_stamp: "Formatted at 2026-08-11 01:36:59 on dist-test-slave-9jjr"
server_key: "11d3565d3043fe34ecc44860bf11340f"
server_key_iv: "60ecbed0f45a9fcb26e26f746672a3c7"
server_key_version: "encryptionkey@0"
I20260811 01:36:59.108381 16818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:36:59.120992 16818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:36:59.125790 16818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:36:59.126178 16818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:36:59.148417 16818 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.252:44939
I20260811 01:36:59.148424 16890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.252:44939 every 8 connection(s)
I20260811 01:36:59.149988 16818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
I20260811 01:36:59.153687 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 16818
I20260811 01:36:59.153893 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786411836859029-23711-0/minicluster-data/master-2/wal/instance
I20260811 01:36:59.154235 16891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:36:59.154527 23711 external_mini_cluster.cc:1428] Setting key 3bf97c771a69d41ec6ee624a953b1e25
I20260811 01:36:59.162351 16730 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 4
I20260811 01:36:59.165110 16891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412219, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:59.182605 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.163086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51132)
0811 01:36:59.163361 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.163381 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:59.163497 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:59.164514 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:59.164521 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:59.165039 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:59.165275 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.165287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.166715 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.166721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.167698 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.167714 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.168783 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.168789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.169020 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.169732 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:59.169765 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:59.173422 (+ 3657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:59.179370 (+ 5948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.179376 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.179382 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.179985 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.180487 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.180492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.180496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.180668 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.181614 (+ 946us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:59.181622 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:59.181805 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 01:36:59.181906 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 01:36:59.182215 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260811 01:36:59.184294 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.163314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51132 (local address 127.23.39.252:44939)
0811 01:36:59.164149 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.164157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.164182 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:36:59.164235 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.164243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.164321 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.164434 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.165469 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.166551 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.167862 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.168576 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.169413 (+ 837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.173717 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.173725 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.173735 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.173779 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.179222 (+ 5443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.180143 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.180147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.180151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.180329 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.180833 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.180837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.180839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.181444 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.182851 (+ 1407us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.182959 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.183189 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":115,"server-negotiator.queue_time_us":685,"thread_start_us":487,"threads_started":1}
I20260811 01:36:59.184521 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.156632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.23.39.252:44939)
0811 01:36:59.157598 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.157611 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.157660 (+ 49us) server_negotiation.cc:407] Connection header received
0811 01:36:59.159500 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.159526 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.159957 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.160348 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.162429 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.164476 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.166447 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.167438 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.167613 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.174008 (+ 6395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.174014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.174019 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.174072 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.179222 (+ 5150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.180074 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.180083 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.180093 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.180286 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.180783 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.180789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.180793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.181420 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.181766 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.182255 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.182777 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":207,"server-negotiator.queue_time_us":736,"thread_start_us":458,"threads_started":1}
I20260811 01:36:59.191972 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.168771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:39063 (local address 127.0.0.1:34300)
0811 01:36:59.172366 (+ 3595us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.172414 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:59.172572 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:59.173195 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:59.173205 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:59.174191 (+ 986us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:59.174608 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.174618 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.176399 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.176406 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.177653 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.177665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.178575 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.178584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.178775 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.179471 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:59.179500 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:59.184220 (+ 4720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:59.188736 (+ 4516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.188752 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.188762 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.189249 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.189791 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.189797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.189800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.189978 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.190738 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:59.190746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:59.190947 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 01:36:59.191190 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 01:36:59.191523 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3364,"thread_start_us":3218,"threads_started":1}
I20260811 01:36:59.191994 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.168336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34300 (local address 127.23.39.254:39063)
0811 01:36:59.172156 (+ 3820us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.172163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.172689 (+ 526us) server_negotiation.cc:407] Connection header received
0811 01:36:59.172752 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.172757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.172837 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.172940 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.174903 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.176226 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.177824 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.178356 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.178510 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.184502 (+ 5992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.184510 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.184515 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.184558 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.188578 (+ 4020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.189391 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.189402 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.189404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.189604 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.190172 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.190177 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.190180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.190586 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.190752 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.191310 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.191535 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3652,"thread_start_us":5552,"threads_started":1}
I20260811 01:36:59.193332 16730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: Bootstrap starting.
I20260811 01:36:59.193498 16891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:36:59.197610 16730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: Neither blocks nor log segments found. Creating new log.
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:36:59.198949 16730 log.cc:824] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: Log is configured to *not* fsync() on all Append() calls
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412219, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:36:59.203099 16730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: No bootstrap required, opened a new log
I20260811 01:36:59.207875 16898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.187820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34316 (local address 127.23.39.254:39063)
0811 01:36:59.189191 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.189201 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.189229 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:36:59.189282 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.189287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.189358 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.189469 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.191090 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.192388 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.193911 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.194931 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.195120 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.200215 (+ 5095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.200228 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.200233 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.200283 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.204128 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.205152 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.205158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.205162 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.205348 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.205881 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.205887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.205891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.206380 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.206644 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.207308 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.207560 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1216,"thread_start_us":1000,"threads_started":1}
I20260811 01:36:59.210457 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.194322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.23.39.253:35841)
0811 01:36:59.194505 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.194511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.194531 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:36:59.194699 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.194705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.194779 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.194881 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.195773 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.196791 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.198711 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.199350 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.199508 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.203541 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.203548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.203554 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.203600 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.207324 (+ 3724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.208203 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.208208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.208213 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.208378 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.208873 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.208879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.208882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.209225 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.209396 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.209826 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.210041 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 01:36:59.211664 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.194232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35841 (local address 127.0.0.1:46542)
0811 01:36:59.194479 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.194494 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:59.194567 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:59.194904 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:59.194909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:59.195393 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:59.195588 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.195602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.196979 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.196987 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.198535 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.198551 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.199546 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.199553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.199752 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.200498 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:59.200520 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:59.203310 (+ 2790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:59.207477 (+ 4167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.207483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.207487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.208041 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.208526 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.208531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.208535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.208720 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.209363 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:59.209369 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:59.209526 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 01:36:59.210786 (+ 1260us) client_negotiation.cc:240] Negotiation successful
0811 01:36:59.211160 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260811 01:36:59.213001 16891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:36:59.213515 16730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.213997 16730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06570a3bf78442219f68a43be9845a47, State: Initialized, Role: FOLLOWER
I20260811 01:36:59.214555 16730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.218746 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.219259 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.220350 16730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412219, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:36:59.230202 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.210531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.23.39.253:35841)
0811 01:36:59.210731 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.210739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.210798 (+ 59us) server_negotiation.cc:407] Connection header received
0811 01:36:59.211044 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.211049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.211124 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.211201 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.213205 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.214343 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.216463 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.216914 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.217051 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.222322 (+ 5271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.222329 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.222334 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.222382 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.226197 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.227222 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.227228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.227231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.227411 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.227926 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.227932 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.227935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.228350 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.228626 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.229262 (+ 636us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.229594 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":4672,"threads_started":1}
I20260811 01:36:59.233842 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.214039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.23.39.252:44939)
0811 01:36:59.214208 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.214215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.214312 (+ 97us) server_negotiation.cc:407] Connection header received
0811 01:36:59.214534 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.214542 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.214620 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.214691 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.215717 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.216421 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.218568 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.219133 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.219235 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.223354 (+ 4119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.223362 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.223369 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.223407 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.226963 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.228930 (+ 1967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.228935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.228938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.229080 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.229624 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.229629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.229641 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.230053 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.230220 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.232200 (+ 1980us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.232919 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 01:36:59.235729 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.213811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51148)
0811 01:36:59.214246 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.214261 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:59.214407 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:59.214892 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:59.214896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:59.215439 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:59.215583 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.215591 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.216590 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.216599 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.218418 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.218432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.219456 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.219461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.219677 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.220315 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:59.220340 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:59.223144 (+ 2804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:59.227232 (+ 4088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.227244 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.227270 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.228811 (+ 1541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.229224 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.229227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.229231 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.229380 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.231338 (+ 1958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:59.231350 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:59.231543 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 01:36:59.235025 (+ 3482us) client_negotiation.cc:240] Negotiation successful
0811 01:36:59.235363 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345}
W20260811 01:36:59.237025 16916 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:36:59.237166 16916 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:36:59.238407 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:36:59.241411 16891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: Bootstrap starting.
I20260811 01:36:59.242153 16702 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "06570a3bf78442219f68a43be9845a47"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34316
I20260811 01:36:59.242631 16702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:36:59.242842 16702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 0 FOLLOWER]: Advancing to term 1
W20260811 01:36:59.244714 16680 tablet.cc:2369] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:59.246795 16891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:59.246789 16702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.248150 16891 log.cc:824] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:59.250114 16702 leader_election.cc:288] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [CANDIDATE]: Term 1 election: Requested vote from peers fd95af01d0304ea3a53ae768735f01ed (127.23.39.253:35841), 314a347151d24deeb22cdfd8cd276be5 (127.23.39.252:44939)
I20260811 01:36:59.231680 16658 master_runner.cc:186] Error getting master registration for 127.23.39.253:35841: OK, instance_id { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" instance_seqno: 1786412218574750 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:36:59.254727 16658 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:36:59.258093 16891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: No bootstrap required, opened a new log
I20260811 01:36:59.286012 16898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.258331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34324 (local address 127.23.39.254:39063)
0811 01:36:59.262413 (+ 4082us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.262428 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.265889 (+ 3461us) server_negotiation.cc:407] Connection header received
0811 01:36:59.266241 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.266249 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.266378 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.266462 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.269058 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.270261 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.272315 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.273039 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.273224 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.277294 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.277301 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.277306 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.277351 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.281259 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.282422 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.282427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.282431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.282607 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.283637 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.283643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.283646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.284064 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.284321 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.285374 (+ 1053us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.285640 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3867}
I20260811 01:36:59.289736 16891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.292869 16891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314a347151d24deeb22cdfd8cd276be5, State: Initialized, Role: FOLLOWER
I20260811 01:36:59.293923 16891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.295665 16926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.296429 16926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.298440 16891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:59.299093 16863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "06570a3bf78442219f68a43be9845a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "314a347151d24deeb22cdfd8cd276be5"
I20260811 01:36:59.299638 16863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:59.303277 16863 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06570a3bf78442219f68a43be9845a47 in term 1.
I20260811 01:36:59.303996 16676 leader_election.cc:302] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06570a3bf78442219f68a43be9845a47, 314a347151d24deeb22cdfd8cd276be5; no voters:
I20260811 01:36:59.304646 16902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:36:59.308470 16809 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } attempt: 5
I20260811 01:36:59.309988 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.258423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.23.39.253:35841)
0811 01:36:59.258707 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.258714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.283119 (+ 24405us) server_negotiation.cc:407] Connection header received
0811 01:36:59.283426 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.283432 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.283523 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.283600 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.285658 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.286804 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.289205 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.289984 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.290114 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.298215 (+ 8101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.298224 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.298231 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.298284 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.302971 (+ 4687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.304918 (+ 1947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.304926 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.304933 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.305174 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.306572 (+ 1398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.306581 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.306587 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.307090 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.307382 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.309312 (+ 1930us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.309581 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260811 01:36:59.317272 16902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [term 1 LEADER]: Becoming Leader. State: Replica: 06570a3bf78442219f68a43be9845a47, State: Running, Role: LEADER
I20260811 01:36:59.318006 16902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
Aug 11 01:36:59 dist-test-slave-9jjr krb5kdc[16645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412218, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:36:59.326144 16928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06570a3bf78442219f68a43be9845a47. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.326629 16928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:59.332952 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.309059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:44939 (local address 127.0.0.1:51164)
0811 01:36:59.309449 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 01:36:59.309472 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 01:36:59.309569 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:36:59.310636 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:36:59.310643 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:36:59.311112 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:36:59.311337 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.311348 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.314669 (+ 3321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.314677 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.315739 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:36:59.315753 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.317061 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.317070 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:36:59.317386 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.320077 (+ 2691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:36:59.320109 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:36:59.323708 (+ 3599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:36:59.329058 (+ 5350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.329066 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.329072 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.329823 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.330415 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:36:59.330420 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:36:59.330424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:36:59.330610 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:36:59.331548 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:36:59.331556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:36:59.331780 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 01:36:59.331974 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 01:36:59.332377 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274}
I20260811 01:36:59.333859 16933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:36:59.335513 16895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.309895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51164 (local address 127.23.39.252:44939)
0811 01:36:59.310112 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.310120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.310195 (+ 75us) server_negotiation.cc:407] Connection header received
0811 01:36:59.310259 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.310264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.310336 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.310428 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.313176 (+ 2748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.314454 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.315900 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.316677 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.316826 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.324041 (+ 7215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.324050 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.324057 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.324116 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.328818 (+ 4702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.330011 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.330018 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.330022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.330267 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.330781 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.330789 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.330795 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.331280 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.331462 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.333539 (+ 2077us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.333872 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 01:36:59.336434 16933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 01:36:59.338704 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.282319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.23.39.252:44939)
0811 01:36:59.282520 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.282526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.290177 (+ 7651us) server_negotiation.cc:407] Connection header received
0811 01:36:59.290255 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.290259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.290350 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.290453 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.293391 (+ 2938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.294541 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.298169 (+ 3628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.299291 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.299414 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.312360 (+ 12946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:36:59.312367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:36:59.312371 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:36:59.312411 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:36:59.319478 (+ 7067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.336058 (+ 16580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.336063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.336066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.336250 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:36:59.336849 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:36:59.336853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:36:59.336856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:36:59.337221 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:36:59.337468 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.338087 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.338357 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:36:59.341830 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: Bootstrap starting.
I20260811 01:36:59.348642 16809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: Neither blocks nor log segments found. Creating new log.
I20260811 01:36:59.349954 16809 log.cc:824] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: Log is configured to *not* fsync() on all Append() calls
I20260811 01:36:59.357599 16863 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [term 1 FOLLOWER]: Refusing update from remote peer 06570a3bf78442219f68a43be9845a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:59.358747 16928 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:59.368368 16809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: No bootstrap required, opened a new log
I20260811 01:36:59.377338 16926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06570a3bf78442219f68a43be9845a47. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.377719 16926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 01:36:59.378716 16839 tablet.cc:2369] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:36:59.379545 16935 mvcc.cc:205] Tried to move back new op lower bound from 7317144450459607040 to 7317144450333335552. Current Snapshot: MvccSnapshot[applied={T|T < 7317144450459607040}]
I20260811 01:36:59.380321 16809 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.380734 16809 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd95af01d0304ea3a53ae768735f01ed, State: Initialized, Role: FOLLOWER
I20260811 01:36:59.381357 16941 mvcc.cc:205] Tried to move back new op lower bound from 7317144450459607040 to 7317144450333335552. Current Snapshot: MvccSnapshot[applied={T|T < 7317144450459607040}]
I20260811 01:36:59.381268 16809 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } }
I20260811 01:36:59.382205 16944 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 01:36:59.383684 16926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.383953 16926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.388064 16947 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.388617 16947 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.390692 16809 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:36:59.391135 16782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:36:59.393880 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.394253 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:59.395057 16933 catalog_manager.cc:1347] Generated new cluster ID: 4a3514769ef94a129391f05f5dff9615
I20260811 01:36:59.395159 16933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:36:59.402344 16783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "06570a3bf78442219f68a43be9845a47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fd95af01d0304ea3a53ae768735f01ed"
I20260811 01:36:59.403307 16782 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [term 1 FOLLOWER]: Refusing update from remote peer 06570a3bf78442219f68a43be9845a47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:36:59.397855 16818 master_runner.cc:186] Error getting master registration for 127.23.39.253:35841: OK, instance_id { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" instance_seqno: 1786412218574750 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:36:59.406690 16818 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:36:59.407052 16783 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06570a3bf78442219f68a43be9845a47 in term 1.
I20260811 01:36:59.408385 16928 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:36:59.444228 16933 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:36:59.446657 16933 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:36:59.461776 16933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47: Generated new TSK 0
I20260811 01:36:59.462944 16928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.463204 16933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 01:36:59.463258 16928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06570a3bf78442219f68a43be9845a47 [sys.catalog]: This master's current role is: LEADER
I20260811 01:36:59.463141 16953 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.463557 16953 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.463917 16947 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06570a3bf78442219f68a43be9845a47. Latest consensus state: current_term: 1 leader_uuid: "06570a3bf78442219f68a43be9845a47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06570a3bf78442219f68a43be9845a47" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 39063 } } peers { permanent_uuid: "fd95af01d0304ea3a53ae768735f01ed" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35841 } } peers { permanent_uuid: "314a347151d24deeb22cdfd8cd276be5" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 44939 } } }
I20260811 01:36:59.464208 16947 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:36:59.487656 16964 catalog_manager.cc:1259] Loaded cluster ID: 4a3514769ef94a129391f05f5dff9615
I20260811 01:36:59.487773 16964 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: loading cluster ID for follower catalog manager: success
I20260811 01:36:59.492154 16964 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: acquiring CA information for follower catalog manager: success
I20260811 01:36:59.495054 16964 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fd95af01d0304ea3a53ae768735f01ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 01:36:59.559141 16898 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.556717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34326 (local address 127.23.39.254:39063)
0811 01:36:59.556886 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.556894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.556915 (+ 21us) server_negotiation.cc:407] Connection header received
0811 01:36:59.556995 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.557002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.557118 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.557222 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.558751 (+ 1529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34326: BlockingRecv error: recv got EOF from 127.0.0.1:34326 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 01:36:59.562191 16815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.557188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46578 (local address 127.23.39.253:35841)
0811 01:36:59.557421 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.557427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.560005 (+ 2578us) server_negotiation.cc:407] Connection header received
0811 01:36:59.560317 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.560326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.560434 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.560525 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.561825 (+ 1300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46578: BlockingRecv error: recv got EOF from 127.0.0.1:46578 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 01:36:59.565619 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.562817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51176 (local address 127.23.39.252:44939)
0811 01:36:59.562999 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.563007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.564246 (+ 1239us) server_negotiation.cc:407] Connection header received
0811 01:36:59.564429 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.564433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.564512 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.564626 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.565321 (+ 695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51176: BlockingRecv error: recv got EOF from 127.0.0.1:51176 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 01:36:59.584333 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.577054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.23.39.253:35841)
0811 01:36:59.577360 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.577366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.577391 (+ 25us) server_negotiation.cc:407] Connection header received
0811 01:36:59.577656 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.577661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.577825 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.577933 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.578608 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.579391 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.581317 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.582023 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.582168 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.582912 (+ 744us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.583540 (+ 628us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.583664 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.583892 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.583990 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
W20260811 01:36:59.626286 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.619905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51190 (local address 127.23.39.252:44939)
0811 01:36:59.620098 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.620104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.624590 (+ 4486us) server_negotiation.cc:407] Connection header received
0811 01:36:59.624894 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.624898 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.625015 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.625141 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.626016 (+ 875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51190: BlockingRecv error: recv got EOF from 127.0.0.1:51190 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:36:59.640003 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.631416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46582 (local address 127.23.39.253:35841)
0811 01:36:59.631603 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.631608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.634841 (+ 3233us) server_negotiation.cc:407] Connection header received
0811 01:36:59.635106 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.635110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.635205 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.635319 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.635809 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.636563 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.637991 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.638529 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.638681 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.639226 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.639360 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.639466 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.639590 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.639698 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 01:36:59.652310 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.647825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51206 (local address 127.23.39.252:44939)
0811 01:36:59.648116 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.648126 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.650779 (+ 2653us) server_negotiation.cc:407] Connection header received
0811 01:36:59.651012 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.651022 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.651103 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.651219 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.652067 (+ 848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51206: BlockingRecv error: recv got EOF from 127.0.0.1:51206 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 01:36:59.667970 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.657374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46590 (local address 127.23.39.253:35841)
0811 01:36:59.657605 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.657615 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.662799 (+ 5184us) server_negotiation.cc:407] Connection header received
0811 01:36:59.663053 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.663057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.663144 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.663252 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.663719 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.664503 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.665936 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.666528 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.666618 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.667126 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.667243 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.667349 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.667487 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.667577 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:36:59.680321 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.674865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.23.39.252:44939)
0811 01:36:59.675090 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.675098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.678774 (+ 3676us) server_negotiation.cc:407] Connection header received
0811 01:36:59.679014 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.679019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.679104 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.679223 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.680059 (+ 836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51214: BlockingRecv error: recv got EOF from 127.0.0.1:51214 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:36:59.694315 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.687642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46604 (local address 127.23.39.253:35841)
0811 01:36:59.687913 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.687923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.688511 (+ 588us) server_negotiation.cc:407] Connection header received
0811 01:36:59.688773 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.688777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.688876 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.688981 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.689437 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.690441 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.692039 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.692805 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.692945 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.693427 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.693533 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.693642 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.693803 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.693893 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260811 01:36:59.711270 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.708642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.23.39.252:44939)
0811 01:36:59.708997 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.709006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.709625 (+ 619us) server_negotiation.cc:407] Connection header received
0811 01:36:59.709865 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.709870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.709962 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.710086 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.711004 (+ 918us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51228: BlockingRecv error: recv got EOF from 127.0.0.1:51228 (error 108)
Metrics: {"server-negotiator.queue_time_us":186}
I20260811 01:36:59.729904 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.723356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.23.39.253:35841)
0811 01:36:59.723637 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.723647 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.724254 (+ 607us) server_negotiation.cc:407] Connection header received
0811 01:36:59.724514 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.724540 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.724678 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.724794 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.725333 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.726244 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.727880 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.728470 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.728617 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.729046 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.729178 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.729281 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.729440 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.729527 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
W20260811 01:36:59.747705 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.744189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.23.39.252:44939)
0811 01:36:59.744709 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.744716 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.745709 (+ 993us) server_negotiation.cc:407] Connection header received
0811 01:36:59.746162 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.746168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.746271 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.746392 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.747417 (+ 1025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51234: BlockingRecv error: recv got EOF from 127.0.0.1:51234 (error 108)
Metrics: {"server-negotiator.queue_time_us":163}
I20260811 01:36:59.775000 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.768237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46622 (local address 127.23.39.253:35841)
0811 01:36:59.768534 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.768550 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.769148 (+ 598us) server_negotiation.cc:407] Connection header received
0811 01:36:59.769437 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.769450 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.769529 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.769664 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.770218 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.771132 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.772679 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.773171 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.773343 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.773826 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.774078 (+ 252us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.774315 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.774543 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.774655 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 01:36:59.784224 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.781881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.23.39.252:44939)
0811 01:36:59.782120 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.782170 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.782732 (+ 562us) server_negotiation.cc:407] Connection header received
0811 01:36:59.782959 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.782964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.783078 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.783191 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.783978 (+ 787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51238: BlockingRecv error: recv got EOF from 127.0.0.1:51238 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 01:36:59.826499 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.819907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46632 (local address 127.23.39.253:35841)
0811 01:36:59.820220 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.820230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.820837 (+ 607us) server_negotiation.cc:407] Connection header received
0811 01:36:59.821183 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.821188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.821267 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.821380 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.821937 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.822803 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.824398 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.825004 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.825160 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.825628 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.825745 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.825849 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.826000 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.826099 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 01:36:59.835670 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.833150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.23.39.252:44939)
0811 01:36:59.833374 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.833381 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.833885 (+ 504us) server_negotiation.cc:407] Connection header received
0811 01:36:59.834119 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.834193 (+ 74us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.834314 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.834440 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.835427 (+ 987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51250: BlockingRecv error: recv got EOF from 127.0.0.1:51250 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 01:36:59.910269 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:36:59.903896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46640 (local address 127.23.39.253:35841)
0811 01:36:59.904131 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.904141 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.904471 (+ 330us) server_negotiation.cc:407] Connection header received
0811 01:36:59.904736 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.904740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.904813 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.904887 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:36:59.905405 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.906297 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.908284 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:36:59.908784 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:36:59.908890 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:36:59.909453 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:36:59.909564 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:36:59.909635 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:36:59.909834 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 01:36:59.909907 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
W20260811 01:36:59.919924 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:36:59.917349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51262 (local address 127.23.39.252:44939)
0811 01:36:59.917548 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 01:36:59.917557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:36:59.918197 (+ 640us) server_negotiation.cc:407] Connection header received
0811 01:36:59.918473 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:36:59.918478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:36:59.918571 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:36:59.918669 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:36:59.919704 (+ 1035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51262: BlockingRecv error: recv got EOF from 127.0.0.1:51262 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 01:37:00.061342 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.055977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46646 (local address 127.23.39.253:35841)
0811 01:37:00.056199 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.056203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.056671 (+ 468us) server_negotiation.cc:407] Connection header received
0811 01:37:00.056829 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.056833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.056908 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.057002 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.057476 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.058214 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.059589 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.060163 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.060274 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.060698 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.060813 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.060884 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.061024 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.061114 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260811 01:37:00.069772 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:00.067794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51264 (local address 127.23.39.252:44939)
0811 01:37:00.068029 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.068036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.068336 (+ 300us) server_negotiation.cc:407] Connection header received
0811 01:37:00.068552 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.068563 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.068635 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.068741 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:00.069564 (+ 823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51264: BlockingRecv error: recv got EOF from 127.0.0.1:51264 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 01:37:00.334822 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.329884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46662 (local address 127.23.39.253:35841)
0811 01:37:00.330068 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.330073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.330356 (+ 283us) server_negotiation.cc:407] Connection header received
0811 01:37:00.330541 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.330546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.330636 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.330730 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.331095 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.331829 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.333212 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.333633 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.333734 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.334110 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.334235 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.334307 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.334527 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.334597 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 01:37:00.343474 16894 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:00.341384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.23.39.252:44939)
0811 01:37:00.341614 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.341620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.341831 (+ 211us) server_negotiation.cc:407] Connection header received
0811 01:37:00.341991 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.341996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.342068 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.342223 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:00.343224 (+ 1001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51268: BlockingRecv error: recv got EOF from 127.0.0.1:51268 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 01:37:00.386535 16944 catalog_manager.cc:1259] Loaded cluster ID: 4a3514769ef94a129391f05f5dff9615
I20260811 01:37:00.386787 16944 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: loading cluster ID for follower catalog manager: success
I20260811 01:37:00.389514 16944 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: acquiring CA information for follower catalog manager: success
I20260811 01:37:00.391568 16944 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 314a347151d24deeb22cdfd8cd276be5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:37:00.869311 17089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.863849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46670 (local address 127.23.39.253:35841)
0811 01:37:00.864349 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.864354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.864374 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:37:00.864562 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.864566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.864640 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.864742 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.865319 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.866065 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.867568 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.867967 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.868067 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.868491 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.868596 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.868663 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.868956 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.869045 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":274,"threads_started":1}
I20260811 01:37:00.882740 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.875644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.23.39.252:44939)
0811 01:37:00.877025 (+ 1381us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.877030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.877050 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:37:00.877133 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.877137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.877292 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.877399 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.877949 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.878786 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.880256 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.880743 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.880864 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.881386 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.882068 (+ 682us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.882305 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.882398 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.882476 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1282,"thread_start_us":1134,"threads_started":1}
I20260811 01:37:00.900624 17089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.890415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46682 (local address 127.23.39.253:35841)
0811 01:37:00.890648 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.890658 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.892756 (+ 2098us) server_negotiation.cc:407] Connection header received
0811 01:37:00.893072 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.893081 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.893212 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.893288 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.894259 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.895472 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.897565 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.898334 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.898494 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.899432 (+ 938us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.899567 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.899668 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.900219 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.900300 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 01:37:00.902184 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.891692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51284 (local address 127.23.39.252:44939)
0811 01:37:00.891940 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.891950 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.894850 (+ 2900us) server_negotiation.cc:407] Connection header received
0811 01:37:00.895017 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.895026 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.895123 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.895226 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.895906 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.897090 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.899286 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.899943 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.900113 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.901326 (+ 1213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.901483 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.901590 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.901769 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.901863 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 01:37:00.902453 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:00.890261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34332 (local address 127.23.39.254:39063)
0811 01:37:00.893355 (+ 3094us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:00.893362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:00.893380 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:37:00.893511 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:00.893518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:00.893777 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:00.894006 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:00.894962 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.895962 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.898641 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:00.899441 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:00.899608 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:00.900250 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:00.900751 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:00.900894 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:00.901163 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 01:37:00.901691 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2966,"thread_start_us":2865,"threads_started":1}
I20260811 01:37:00.908264 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16658
I20260811 01:37:00.909552 16725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:01.030478 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16658
I20260811 01:37:01.057372 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16737
I20260811 01:37:01.058605 16804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:01.170995 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16737
I20260811 01:37:01.194435 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 16818
I20260811 01:37:01.195667 16886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:01.305245 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 16818
2026-08-11T01:37:01Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5364 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 01:37:01 dist-test-slave-9jjr krb5kdc[17111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 01:37:01 dist-test-slave-9jjr krb5kdc[17111](info): set up 2 sockets
Aug 11 01:37:01 dist-test-slave-9jjr krb5kdc[17111](info): commencing operation
krb5kdc: starting...
W20260811 01:37:02.600293 23711 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/test-user.keytab.
Aug 11 01:37:02 dist-test-slave-9jjr krb5kdc[17111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T01:37:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T01:37:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.39.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
Entry for principal kudu/127.23.39.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab.
I20260811 01:37:02.994306 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38071
--webserver_interface=127.23.39.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 01:37:03.362644 17124 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:37:03.363020 17124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:03.363108 17124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:03.363198 17124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:03.370750 17124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:03.370862 17124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:03.370930 17124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:03.370985 17124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:03.371049 17124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:03.381739 17124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.254.keytab
--principal=kudu/127.23.39.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.254:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.39.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:03.383239 17124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:03.384621 17124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:03.397662 17129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:03.397627 17130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:03.397639 17132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:03.399097 17124 server_base.cc:1034] running on GCE node
I20260811 01:37:03.400048 17124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:03.401679 17124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:03.402942 17124 hybrid_clock.cc:648] HybridClock initialized: now 1786412223402865 us; error 53 us; skew 500 ppm
I20260811 01:37:03.403298 17124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:03 dist-test-slave-9jjr krb5kdc[17111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:03.412762 17124 init.cc:377] Logged in from keytab as kudu/127.23.39.254@KRBTEST.COM (short username kudu)
I20260811 01:37:03.414525 17124 webserver.cc:460] Webserver started at http://127.23.39.254:33555/ using document root <none> and password file <none>
I20260811 01:37:03.415251 17124 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:03.415347 17124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:03.415729 17124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:03.418964 17124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data/instance:
uuid: "ed0359508600441aa07073b9eab50362"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "07e8e2dd3d572feaa0c6aa56870db56c"
server_key_iv: "378f5b3e1f66fc0a1416a5193454ed00"
server_key_version: "encryptionkey@0"
I20260811 01:37:03.419806 17124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance:
uuid: "ed0359508600441aa07073b9eab50362"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "07e8e2dd3d572feaa0c6aa56870db56c"
server_key_iv: "378f5b3e1f66fc0a1416a5193454ed00"
server_key_version: "encryptionkey@0"
I20260811 01:37:03.425624 17124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 01:37:03.429420 17139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:03.431025 17124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 01:37:03.431198 17124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal
uuid: "ed0359508600441aa07073b9eab50362"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "07e8e2dd3d572feaa0c6aa56870db56c"
server_key_iv: "378f5b3e1f66fc0a1416a5193454ed00"
server_key_version: "encryptionkey@0"
I20260811 01:37:03.431403 17124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:03.447408 17124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:03.452291 17124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:03.452538 17124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:03.473183 17124 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.254:38071
I20260811 01:37:03.473188 17193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.254:38071 every 8 connection(s)
I20260811 01:37:03.474833 17124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/data/info.pb
I20260811 01:37:03.479297 17194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:03.483251 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 17124
I20260811 01:37:03.483481 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-0/wal/instance
I20260811 01:37:03.484084 23711 external_mini_cluster.cc:1428] Setting key 2dc2c8f7177d05c08aec807cad279f46
I20260811 01:37:03.488914 17194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:37:03 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:37:03.517727 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.494697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.23.39.254:38071)
0811 01:37:03.495494 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:03.495506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:03.495565 (+ 59us) server_negotiation.cc:407] Connection header received
0811 01:37:03.496976 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:03.496987 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:03.497359 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:03.497623 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:03.499034 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:03.501076 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:03.503748 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:03.504480 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:03.504661 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:03.509478 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:03.509488 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:03.509502 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:03.509544 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:03.512736 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:03.513573 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:03.513580 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:03.513582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:03.513753 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:03.514226 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:03.514231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:03.514233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:03.514807 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:03.515037 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:03.515624 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 01:37:03.516094 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":536,"thread_start_us":333,"threads_started":1}
I20260811 01:37:03.517751 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.493248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38071 (local address 127.0.0.1:46456)
0811 01:37:03.494205 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.494272 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:03.496527 (+ 2255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:03.497650 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:03.497655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:03.498388 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:03.498779 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:03.498799 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:03.501326 (+ 2527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:03.501336 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:03.503482 (+ 2146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:03.503511 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:03.504800 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:03.504810 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:03.505076 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:03.505963 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:03.506002 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:03.509177 (+ 3175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:03.512912 (+ 3735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:03.512926 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:03.512940 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:03.513404 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:03.513878 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:03.513884 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:03.513887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:03.514062 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:03.514970 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:03.514978 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:03.515206 (+ 228us) client_negotiation.cc:769] Sending connection context
0811 01:37:03.515480 (+ 274us) client_negotiation.cc:240] Negotiation successful
0811 01:37:03.516218 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":221,"thread_start_us":399,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.253@KRBTEST.COM; defaulting to no policy
I20260811 01:37:03.521440 17194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:37:03.522941 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.522319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:60982)
0811 01:37:03.522508 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.522803 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 01:37:03.523345 17141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.253@KRBTEST.COM" created.
I20260811 01:37:03.525266 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.524808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:60988)
0811 01:37:03.525005 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.525084 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:37:03.525514 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35025: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
Entry for principal kudu/127.23.39.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab.
I20260811 01:37:03.570513 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:35025
--webserver_interface=127.23.39.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:37:03.574959 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } attempt: 1
I20260811 01:37:03.576320 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.575796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:60998)
0811 01:37:03.576016 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.576181 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 01:37:03.577406 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.577024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32774)
0811 01:37:03.577183 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.577261 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 01:37:03.577605 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35025: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
I20260811 01:37:03.645908 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } attempt: 2
I20260811 01:37:03.647392 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.646763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32776)
0811 01:37:03.647063 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.647198 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 01:37:03.648563 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.648109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32792)
0811 01:37:03.648279 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.648390 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:37:03.648845 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35025: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
I20260811 01:37:03.740185 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } attempt: 3
I20260811 01:37:03.741611 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.741039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32802)
0811 01:37:03.741309 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.741431 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 01:37:03.742934 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.742468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32806)
0811 01:37:03.742641 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.742740 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 01:37:03.743325 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35025: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
I20260811 01:37:03.886610 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } attempt: 4
I20260811 01:37:03.888016 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.887324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32816)
0811 01:37:03.887692 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.887828 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260811 01:37:03.889315 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:03.888842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32830)
0811 01:37:03.889027 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:03.889144 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 01:37:03.889560 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.253:35025: Network error: Client connection negotiation failed: client connection to 127.23.39.253:35025: connect: Connection refused (error 111)
W20260811 01:37:03.947912 17203 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:37:03.948333 17203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:03.948489 17203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:03.948637 17203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:03.957139 17203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:03.957257 17203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:03.957367 17203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:03.957454 17203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:03.957548 17203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:03.968389 17203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.253.keytab
--principal=kudu/127.23.39.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.253:35025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.39.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:03.969898 17203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:03.971392 17203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:03.984431 17208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:03.984454 17211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:03.984407 17209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:03.985204 17203 server_base.cc:1034] running on GCE node
I20260811 01:37:03.986176 17203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:03.987757 17203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:03.988994 17203 hybrid_clock.cc:648] HybridClock initialized: now 1786412223988901 us; error 66 us; skew 500 ppm
I20260811 01:37:03.989320 17203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:03 dist-test-slave-9jjr krb5kdc[17111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:03.992877 17203 init.cc:377] Logged in from keytab as kudu/127.23.39.253@KRBTEST.COM (short username kudu)
I20260811 01:37:03.994694 17203 webserver.cc:460] Webserver started at http://127.23.39.253:44041/ using document root <none> and password file <none>
I20260811 01:37:03.995472 17203 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:03.995621 17203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:03.995970 17203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:03.999341 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data/instance:
uuid: "8b606c3ef3a24bebbd388129403b2d0d"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "1e147465e2e9ad0f8259bff4aa617460"
server_key_iv: "e28c107f4c1e1a09fac55c407cc56a44"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.000272 17203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal/instance:
uuid: "8b606c3ef3a24bebbd388129403b2d0d"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "1e147465e2e9ad0f8259bff4aa617460"
server_key_iv: "e28c107f4c1e1a09fac55c407cc56a44"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.006325 17203 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 01:37:04.010396 17219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:04.011986 17203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 01:37:04.012274 17203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal
uuid: "8b606c3ef3a24bebbd388129403b2d0d"
format_stamp: "Formatted at 2026-08-11 01:37:03 on dist-test-slave-9jjr"
server_key: "1e147465e2e9ad0f8259bff4aa617460"
server_key_iv: "e28c107f4c1e1a09fac55c407cc56a44"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.012537 17203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:04.030424 17203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:04.035578 17203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:04.035941 17203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:04.056761 17203 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.253:35025
I20260811 01:37:04.056773 17275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.253:35025 every 8 connection(s)
I20260811 01:37:04.058351 17203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/data/info.pb
I20260811 01:37:04.060348 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 17203
I20260811 01:37:04.060606 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-1/wal/instance
I20260811 01:37:04.061070 23711 external_mini_cluster.cc:1428] Setting key 343e5e4fc8c38725a87395de804b5e4a
I20260811 01:37:04.062652 17276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:04.069909 17276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:37:04.095876 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.073001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46460 (local address 127.23.39.254:38071)
0811 01:37:04.073558 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.073563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.074861 (+ 1298us) server_negotiation.cc:407] Connection header received
0811 01:37:04.077219 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.077223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.077301 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.077405 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.079916 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.080757 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.083468 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.083930 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.084037 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.088911 (+ 4874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.088917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.088920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.088974 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.091958 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.092850 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.092855 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.092858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.092989 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.093549 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.093558 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.093564 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.094001 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.094250 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.095071 (+ 821us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.095392 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":318,"threads_started":1}
I20260811 01:37:04.096552 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.073680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38071 (local address 127.0.0.1:46460)
0811 01:37:04.074661 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.074706 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.076793 (+ 2087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.077757 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.077772 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.078736 (+ 964us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.079615 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.079646 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.080971 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.080979 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.083285 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.083304 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.084204 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.084216 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.084629 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.085462 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.085504 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.088594 (+ 3090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.092150 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.092161 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.092181 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.092690 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.093110 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.093117 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.093120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.093359 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.094213 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.094220 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.094624 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.094891 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.095318 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":479,"threads_started":1}
WARNING: no policy specified for kudu/127.23.39.252@KRBTEST.COM; defaulting to no policy
I20260811 01:37:04.098760 17276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.39.252@KRBTEST.COM" created.
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:37:04.117190 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.099589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32838)
0811 01:37:04.099839 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.099858 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.099975 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.101073 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.101084 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.101586 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.101799 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.101840 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.103388 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.103396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.104903 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.104923 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.105868 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.105876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.106116 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.106875 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.106904 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.109927 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.113717 (+ 3790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.113726 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.113733 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.114406 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.114906 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.114915 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.114921 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.115121 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.115913 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.115920 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.116101 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.116272 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.116667 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 01:37:04.117228 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.099832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32838 (local address 127.23.39.253:35025)
0811 01:37:04.100555 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.100561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.100589 (+ 28us) server_negotiation.cc:407] Connection header received
0811 01:37:04.100635 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.100641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.100841 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.101003 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.102041 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.103223 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.105087 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.105688 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.105793 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.110313 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.110330 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.110345 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.110380 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.113512 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.114590 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.114598 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.114600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.114781 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.115265 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.115269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.115271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.115747 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.115928 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.116451 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.116906 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":127,"server-negotiator.queue_time_us":563,"thread_start_us":416,"threads_started":1}
I20260811 01:37:04.120144 17276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:37:04.121349 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.120867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54614)
0811 01:37:04.121054 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.121175 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 01:37:04.121646 17223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.123432 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.123054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54624)
0811 01:37:04.123224 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.123316 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:37:04.123678 17276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
Entry for principal kudu/127.23.39.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab.
I20260811 01:37:04.145825 23711 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuc9edm/build/asan/bin/kudu
/tmp/dist-test-taskuc9edm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:36607
--webserver_interface=127.23.39.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.39.212:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 01:37:04.173061 17276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 1
I20260811 01:37:04.174523 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.173845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54630)
0811 01:37:04.174150 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.174298 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 01:37:04.175819 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.175434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54632)
0811 01:37:04.175595 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.175705 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 01:37:04.176133 17276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.188817 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } attempt: 5
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:37:04.203783 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.189811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.23.39.253:35025)
0811 01:37:04.189993 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.189997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.190017 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:37:04.190092 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.190095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.190241 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.190324 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.191382 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.192090 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.193738 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.194262 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.194362 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.198318 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.198323 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.198326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.198362 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.201054 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.201878 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.201882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.201884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.202004 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.202448 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.202452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.202454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.202755 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.202869 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.203365 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.203544 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 01:37:04.203946 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.189559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32854)
0811 01:37:04.189808 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.189845 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.189981 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.190392 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.190400 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.190926 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.191202 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.191216 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.192237 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.192242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.193570 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.193586 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.194415 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.194421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.194655 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.195425 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.195448 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.198020 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.201219 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.201224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.201228 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.201748 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.202120 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.202149 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.202152 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.202328 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.202877 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.202881 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.203097 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.203258 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.203603 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 01:37:04.205150 17194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:37:04.206414 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.205909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54642)
0811 01:37:04.206108 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.206255 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 01:37:04.207374 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.207039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54644)
0811 01:37:04.207184 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.207275 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 01:37:04.207569 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.244431 17276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 2
I20260811 01:37:04.245908 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.245375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54654)
0811 01:37:04.245634 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.245732 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260811 01:37:04.247010 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.246661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54664)
0811 01:37:04.246812 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.246890 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 01:37:04.247238 17276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.258806 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 1
I20260811 01:37:04.260069 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.259554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54672)
0811 01:37:04.259784 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.259888 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 01:37:04.261104 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.260762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54682)
0811 01:37:04.260914 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.260995 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 01:37:04.261333 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.329576 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 2
I20260811 01:37:04.330989 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.330431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54690)
0811 01:37:04.330710 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.330808 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 01:37:04.332052 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.331699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54700)
0811 01:37:04.331852 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.331931 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 01:37:04.332259 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.338442 17276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 3
I20260811 01:37:04.339653 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.339135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54708)
0811 01:37:04.339359 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.339479 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 01:37:04.340776 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.340328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54714)
0811 01:37:04.340571 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.340647 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260811 01:37:04.340968 17276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.438489 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 3
I20260811 01:37:04.439848 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.439291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54728)
0811 01:37:04.439534 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.439628 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260811 01:37:04.441025 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.440581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54738)
0811 01:37:04.440820 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.440904 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260811 01:37:04.441233 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.484185 17276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 4
I20260811 01:37:04.485343 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.484858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54742)
0811 01:37:04.485104 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.485189 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 01:37:04.486382 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.486033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54756)
0811 01:37:04.486208 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.486284 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 01:37:04.486613 17276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
W20260811 01:37:04.522868 17284 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 01:37:04.523342 17284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 01:37:04.523454 17284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 01:37:04.523597 17284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 01:37:04.531162 17284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 01:37:04.531276 17284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 01:37:04.531370 17284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 01:37:04.531452 17284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 01:37:04.531561 17284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 01:37:04.542012 17284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.39.212:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.39.254:38071,127.23.39.253:35025,127.23.39.252:36607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/krb5kdc/kudu_127.23.39.252.keytab
--principal=kudu/127.23.39.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.39.252:36607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.39.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 00:28:44 UTC on ccycloud.quasar-xgjmlp.root.comops.site
build id 4579415
ASAN enabled
I20260811 01:37:04.543501 17284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 01:37:04.544865 17284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 01:37:04.557390 17289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:04.557337 17290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 01:37:04.557425 17292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 01:37:04.558332 17284 server_base.cc:1034] running on GCE node
I20260811 01:37:04.559235 17284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 01:37:04.560885 17284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 01:37:04.562317 17284 hybrid_clock.cc:648] HybridClock initialized: now 1786412224562187 us; error 73 us; skew 500 ppm
I20260811 01:37:04.562793 17284 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412224, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 01:37:04.566660 17284 init.cc:377] Logged in from keytab as kudu/127.23.39.252@KRBTEST.COM (short username kudu)
I20260811 01:37:04.568531 17284 webserver.cc:460] Webserver started at http://127.23.39.252:39985/ using document root <none> and password file <none>
I20260811 01:37:04.569339 17284 fs_manager.cc:359] Metadata directory not provided
I20260811 01:37:04.569499 17284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 01:37:04.569859 17284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 01:37:04.573403 17284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data/instance:
uuid: "288516dae1364b3eb795855606fdfe20"
format_stamp: "Formatted at 2026-08-11 01:37:04 on dist-test-slave-9jjr"
server_key: "5eeb174bbc0d6bce8d209dbc146e1f32"
server_key_iv: "516194014f1dadac387fcc599fd0f7b4"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.574447 17284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal/instance:
uuid: "288516dae1364b3eb795855606fdfe20"
format_stamp: "Formatted at 2026-08-11 01:37:04 on dist-test-slave-9jjr"
server_key: "5eeb174bbc0d6bce8d209dbc146e1f32"
server_key_iv: "516194014f1dadac387fcc599fd0f7b4"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.580397 17284 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 01:37:04.584242 17300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 01:37:04.585762 17284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 01:37:04.586009 17284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data,/tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal
uuid: "288516dae1364b3eb795855606fdfe20"
format_stamp: "Formatted at 2026-08-11 01:37:04 on dist-test-slave-9jjr"
server_key: "5eeb174bbc0d6bce8d209dbc146e1f32"
server_key_iv: "516194014f1dadac387fcc599fd0f7b4"
server_key_version: "encryptionkey@0"
I20260811 01:37:04.586354 17284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 01:37:04.608240 17284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 01:37:04.613312 17284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 01:37:04.613644 17284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 01:37:04.618450 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 4
I20260811 01:37:04.619536 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.619096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54762)
0811 01:37:04.619302 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.619398 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 01:37:04.621028 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.620405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54774)
0811 01:37:04.620673 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.620811 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260811 01:37:04.621371 17194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.39.252:36607: Network error: Client connection negotiation failed: client connection to 127.23.39.252:36607: connect: Connection refused (error 111)
I20260811 01:37:04.635715 17284 rpc_server.cc:307] RPC server started. Bound to: 127.23.39.252:36607
I20260811 01:37:04.635772 17356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.39.252:36607 every 8 connection(s)
I20260811 01:37:04.637295 17284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/data/info.pb
I20260811 01:37:04.641541 17357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 01:37:04.644869 23711 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuc9edm/build/asan/bin/kudu as pid 17284
I20260811 01:37:04.645087 23711 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuc9edm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786411836859029-23711-0/minicluster-data/master-2/wal/instance
I20260811 01:37:04.645670 23711 external_mini_cluster.cc:1428] Setting key 74c13d61962741e4a70ab7963e443518
I20260811 01:37:04.651283 17357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412224, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:37:04.676249 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.654265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.23.39.254:38071)
0811 01:37:04.654838 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.654845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.655542 (+ 697us) server_negotiation.cc:407] Connection header received
0811 01:37:04.655783 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.655789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.655897 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.656041 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.657876 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.659339 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.661613 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.662526 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.662678 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.668517 (+ 5839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.668527 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.668532 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.668643 (+ 111us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.672697 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.673578 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.673587 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.673592 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.673795 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.674399 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.674405 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.674408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.674797 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.674958 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.675529 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.675801 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":272,"threads_started":1}
I20260811 01:37:04.676412 17362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.654291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.254:38071 (local address 127.0.0.1:46468)
0811 01:37:04.655349 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.655398 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.655619 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.656255 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.656265 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.657291 (+ 1026us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.657664 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.657678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.659541 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.659548 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.661377 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.661400 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.663030 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.663041 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.663322 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.664343 (+ 1021us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.664379 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.668186 (+ 3807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.672854 (+ 4668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.672865 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.672871 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.673421 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.673967 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.673976 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.673983 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.674240 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.674981 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.674987 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.675177 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.675347 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.675599 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":560,"threads_started":1}
I20260811 01:37:04.676468 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.648009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54780 (local address 127.23.39.252:36607)
0811 01:37:04.648928 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.648942 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.648990 (+ 48us) server_negotiation.cc:407] Connection header received
0811 01:37:04.651073 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.651100 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.651630 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.652187 (+ 557us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.653861 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.655893 (+ 2032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.658080 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.658912 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.659150 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.665630 (+ 6480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.665647 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.665667 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.665721 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.670504 (+ 4783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.671787 (+ 1283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.671797 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.671810 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.672081 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.672665 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.672670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.672674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.673511 (+ 837us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.673861 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.674421 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.674953 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"spinlock_wait_cycles":33024,"thread_start_us":395,"threads_started":1}
I20260811 01:37:04.679816 17357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412224, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.254@KRBTEST.COM
I20260811 01:37:04.695844 17362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.680595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.253:35025 (local address 127.0.0.1:32856)
0811 01:37:04.680792 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.680813 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.680930 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.681242 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.681245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.681642 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.681809 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.681818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.683247 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.683253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.684436 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.684450 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.685555 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.685562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.685756 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.686529 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.686558 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.689020 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.693058 (+ 4038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.693064 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.693068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.693499 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.693945 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.693950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.693954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.694117 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.694721 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.694726 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.694916 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.695074 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.695418 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 01:37:04.695880 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.680692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32856 (local address 127.23.39.253:35025)
0811 01:37:04.680900 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.680906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.680926 (+ 20us) server_negotiation.cc:407] Connection header received
0811 01:37:04.681028 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.681033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.681113 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.681240 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.681980 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.683033 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.684597 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.685379 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.685500 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.689251 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.689261 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.689268 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.689317 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.692904 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.693641 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.693647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.693651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.693819 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.694282 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.694289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.694292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.694592 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.694774 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.695175 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.695418 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 01:37:04.696926 17357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } has no permanent_uuid. Determining permanent_uuid...
I20260811 01:37:04.699045 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.680127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46470 (local address 127.23.39.254:38071)
0811 01:37:04.680410 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.680414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.680455 (+ 41us) server_negotiation.cc:407] Connection header received
0811 01:37:04.680586 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.680591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.680697 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.680813 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.682683 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.683671 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.685421 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.686227 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.686388 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.691854 (+ 5466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.691862 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.691867 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.691917 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.695028 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.695815 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.695823 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.695827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.696268 (+ 441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.696883 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.696887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.696890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.697305 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.697594 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.698414 (+ 820us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.698718 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412224, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.252@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.39.253@KRBTEST.COM
I20260811 01:37:04.713377 17362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.697776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54782)
0811 01:37:04.697953 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.697970 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.698060 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.698778 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.698782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.699248 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.699431 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.699448 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.700636 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.700645 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.702297 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.702317 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.703114 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.703124 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.703347 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.704054 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.704095 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.707136 (+ 3041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.710513 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.710517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.710520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.710982 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.711375 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.711384 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.711388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.711529 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.712230 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.712235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.712408 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.712567 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.712913 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 01:37:04.713377 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.698274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54782 (local address 127.23.39.252:36607)
0811 01:37:04.698459 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.698466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.698484 (+ 18us) server_negotiation.cc:407] Connection header received
0811 01:37:04.698532 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.698537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.698615 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.698723 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.699585 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.700471 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.702458 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.702915 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.703024 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.707406 (+ 4382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.707412 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.707415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.707449 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.710355 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.711123 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.711128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.711133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.711265 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.711646 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.711655 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.711666 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.711948 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.712263 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.712685 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.713069 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":157,"server-negotiator.queue_time_us":62}
I20260811 01:37:04.718725 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.700886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32866 (local address 127.23.39.253:35025)
0811 01:37:04.701059 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.701064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.701086 (+ 22us) server_negotiation.cc:407] Connection header received
0811 01:37:04.701277 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.701281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.701342 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.701425 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.703231 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.704017 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.706025 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.706778 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.706892 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.712138 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.712145 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.712151 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.712199 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.715552 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.716654 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.716658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.716660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.716818 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.717249 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.717252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.717254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.717570 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.717830 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.718197 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.718420 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 01:37:04.720515 17357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: Bootstrap starting.
I20260811 01:37:04.724475 23711 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 01:37:04.724725 17357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:04.726187 17357 log.cc:824] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:04.729319 17357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: No bootstrap required, opened a new log
I20260811 01:37:04.727851 17167 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ed0359508600441aa07073b9eab50362"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46470
I20260811 01:37:04.736979 17357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.737385 17357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288516dae1364b3eb795855606fdfe20, State: Initialized, Role: FOLLOWER
I20260811 01:37:04.737854 17357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.738847 17366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:04.739192 17366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:04.740067 17357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:37:04.750101 17377 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:37:04.750273 17377 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:37:04.747805 17284 master_runner.cc:186] Error getting master registration for 127.23.39.254:38071: OK, instance_id { permanent_uuid: "ed0359508600441aa07073b9eab50362" instance_seqno: 1786412223467213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:37:04.758919 17284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 01:37:04.785876 17276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 5
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.253@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:37:04.803891 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.786762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54798)
0811 01:37:04.786970 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.787002 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.787179 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.787539 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.787544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.788006 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.788238 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.788248 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.789605 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.789613 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.790891 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.790913 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.792071 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.792077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.792345 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.793118 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.793181 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.796059 (+ 2878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.800570 (+ 4511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.800576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.800581 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.801255 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.801750 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.801755 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.801759 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.801936 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.802767 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.802772 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.802949 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.803137 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.803472 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 01:37:04.803930 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.787008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.23.39.252:36607)
0811 01:37:04.787213 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.787221 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.787245 (+ 24us) server_negotiation.cc:407] Connection header received
0811 01:37:04.787313 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.787318 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.787393 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.787504 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.788407 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.789439 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.791067 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.791877 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.792050 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.796323 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.796331 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.796336 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.796384 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.800325 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.801427 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.801434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.801438 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.801604 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.802067 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.802073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.802077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.802634 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.802826 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.803273 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.803531 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 01:37:04.810606 17276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: Bootstrap starting.
I20260811 01:37:04.814992 17276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:04.816402 17276 log.cc:824] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:04.820122 17276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: No bootstrap required, opened a new log
I20260811 01:37:04.831699 17276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.832195 17276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b606c3ef3a24bebbd388129403b2d0d, State: Initialized, Role: FOLLOWER
I20260811 01:37:04.832793 17276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.833931 17381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:04.834398 17381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:04.835336 17276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: configured and running, proceeding with master startup.
W20260811 01:37:04.853102 17392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 01:37:04.853350 17392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 01:37:04.849699 17203 master_runner.cc:186] Error getting master registration for 127.23.39.254:38071: OK, instance_id { permanent_uuid: "ed0359508600441aa07073b9eab50362" instance_seqno: 1786412223467213 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 01:37:04.861963 17203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 01:37:04.866109 17306 tablet.cc:2369] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:04.898620 17194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } attempt: 5
Aug 11 01:37:04 dist-test-slave-9jjr krb5kdc[17111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786412223, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.39.254@KRBTEST.COM for kudu/127.23.39.252@KRBTEST.COM
I20260811 01:37:04.917866 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.899457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.39.252:36607 (local address 127.0.0.1:54808)
0811 01:37:04.899774 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 01:37:04.899796 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 01:37:04.899944 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 01:37:04.900397 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 01:37:04.900402 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 01:37:04.900958 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 01:37:04.901184 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.901198 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.902712 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.902718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.904484 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 01:37:04.904519 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.905719 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.905727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 01:37:04.905937 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.906762 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 01:37:04.906789 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 01:37:04.909919 (+ 3130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 01:37:04.914663 (+ 4744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.914670 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.914675 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.915287 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.915794 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 01:37:04.915800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 01:37:04.915804 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 01:37:04.916019 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 01:37:04.916662 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 01:37:04.916668 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 01:37:04.916865 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 01:37:04.917040 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 01:37:04.917441 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260811 01:37:04.917896 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:04.899556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.23.39.252:36607)
0811 01:37:04.899764 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:04.899770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:04.899877 (+ 107us) server_negotiation.cc:407] Connection header received
0811 01:37:04.900112 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:04.900118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:04.900228 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:04.900337 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:04.901366 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.902561 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.904735 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:04.905522 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:04.905670 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:04.910214 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:04.910223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:04.910228 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:04.910284 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:04.914449 (+ 4165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.915424 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.915431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.915435 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.915639 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:04.916136 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:04.916140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:04.916144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:04.916525 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:04.916746 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:04.917164 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 01:37:04.917416 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:37:04.924911 17194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362: Bootstrap starting.
I20260811 01:37:04.929446 17194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362: Neither blocks nor log segments found. Creating new log.
I20260811 01:37:04.931048 17194 log.cc:824] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362: Log is configured to *not* fsync() on all Append() calls
I20260811 01:37:04.941309 17194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362: No bootstrap required, opened a new log
I20260811 01:37:04.949998 17194 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.950573 17194 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0359508600441aa07073b9eab50362, State: Initialized, Role: FOLLOWER
I20260811 01:37:04.951159 17194 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.959052 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:04.959542 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:04.961618 17194 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 01:37:04.961737 17167 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 01:37:04.962100 17167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:04.965922 17167 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.969620 17167 leader_election.cc:288] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [CANDIDATE]: Term 1 election: Requested vote from peers 8b606c3ef3a24bebbd388129403b2d0d (127.23.39.253:35025), 288516dae1364b3eb795855606fdfe20 (127.23.39.252:36607)
I20260811 01:37:04.970556 17248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed0359508600441aa07073b9eab50362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8b606c3ef3a24bebbd388129403b2d0d"
I20260811 01:37:04.971148 17248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:04.975143 17248 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0359508600441aa07073b9eab50362 in term 1.
I20260811 01:37:04.975081 17328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed0359508600441aa07073b9eab50362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "288516dae1364b3eb795855606fdfe20"
I20260811 01:37:04.975680 17328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 01:37:04.976006 17141 leader_election.cc:302] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b606c3ef3a24bebbd388129403b2d0d, ed0359508600441aa07073b9eab50362; no voters:
I20260811 01:37:04.976613 17395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 01:37:04.980238 17328 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0359508600441aa07073b9eab50362 in term 1.
I20260811 01:37:04.985780 17395 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [term 1 LEADER]: Becoming Leader. State: Replica: ed0359508600441aa07073b9eab50362, State: Running, Role: LEADER
I20260811 01:37:04.986955 17395 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } }
I20260811 01:37:04.995649 17397 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed0359508600441aa07073b9eab50362. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:04.996412 17397 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:05.003120 17402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 01:37:05.021229 17402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 01:37:05.038945 17225 tablet.cc:2369] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 01:37:05.055753 17328 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [term 1 FOLLOWER]: Refusing update from remote peer ed0359508600441aa07073b9eab50362: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:05.057157 17397 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:05.064234 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:05.020490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32872 (local address 127.23.39.253:35025)
0811 01:37:05.020711 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.020718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.028411 (+ 7693us) server_negotiation.cc:407] Connection header received
0811 01:37:05.028947 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.028954 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.029048 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.029139 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.031823 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.033026 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.040433 (+ 7407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.041210 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.041340 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:05.052175 (+ 10835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:05.052184 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:05.052189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:05.052245 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:05.056890 (+ 4645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.058395 (+ 1505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.058401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.058404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.058584 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.059502 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.059508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.059511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.059979 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:05.060252 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:05.062360 (+ 2108us) server_negotiation.cc:299] Negotiation successful
0811 01:37:05.062656 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 01:37:05.066391 17248 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [term 1 FOLLOWER]: Refusing update from remote peer ed0359508600441aa07073b9eab50362: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 01:37:05.068259 17397 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 01:37:05.105043 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:05.024857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46476 (local address 127.23.39.254:38071)
0811 01:37:05.025066 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.025076 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.033719 (+ 8643us) server_negotiation.cc:407] Connection header received
0811 01:37:05.034244 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.034250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.034339 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.034434 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.049743 (+ 15309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.051083 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.066928 (+ 15845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.067709 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.067847 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:05.090221 (+ 22374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:05.090230 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:05.090235 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:05.090296 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:05.101251 (+ 10955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.102264 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.102271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.102274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.102451 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.102963 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.102968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.102972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.103391 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:05.103668 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:05.104393 (+ 725us) server_negotiation.cc:299] Negotiation successful
0811 01:37:05.104666 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 01:37:05.105533 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:05.035671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54816 (local address 127.23.39.252:36607)
0811 01:37:05.035936 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.035945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.063265 (+ 27320us) server_negotiation.cc:407] Connection header received
0811 01:37:05.064578 (+ 1313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.064584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.064672 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.064748 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.071859 (+ 7111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.072954 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.080123 (+ 7169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:05.080936 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:05.081058 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:05.093745 (+ 12687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 01:37:05.093754 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 01:37:05.093759 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 01:37:05.093812 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 01:37:05.098288 (+ 4476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.101737 (+ 3449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.101745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.101749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.101951 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 01:37:05.102573 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 01:37:05.102579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 01:37:05.102584 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 01:37:05.103086 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 01:37:05.103397 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:05.104779 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0811 01:37:05.105108 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 01:37:05.110872 17366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed0359508600441aa07073b9eab50362. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.111248 17366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:05.115306 17411 mvcc.cc:205] Tried to move back new op lower bound from 7317144473790476288 to 7317144473553756160. Current Snapshot: MvccSnapshot[applied={T|T < 7317144473790476288}]
I20260811 01:37:05.122434 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.122865 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:05.130453 17381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed0359508600441aa07073b9eab50362. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.130900 17381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:05.133103 17402 catalog_manager.cc:1347] Generated new cluster ID: e049cb4d3e7445d1b4620818860d40a5
I20260811 01:37:05.133239 17402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 01:37:05.139328 17366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.139699 17366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:05.143908 17397 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.144249 17397 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362 [sys.catalog]: This master's current role is: LEADER
I20260811 01:37:05.147117 17418 mvcc.cc:205] Tried to move back new op lower bound from 7317144473790476288 to 7317144473553756160. Current Snapshot: MvccSnapshot[applied={T|T < 7317144473790476288}]
I20260811 01:37:05.154831 17402 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 01:37:05.155855 17381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ed0359508600441aa07073b9eab50362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed0359508600441aa07073b9eab50362" member_type: VOTER last_known_addr { host: "127.23.39.254" port: 38071 } } peers { permanent_uuid: "8b606c3ef3a24bebbd388129403b2d0d" member_type: VOTER last_known_addr { host: "127.23.39.253" port: 35025 } } peers { permanent_uuid: "288516dae1364b3eb795855606fdfe20" member_type: VOTER last_known_addr { host: "127.23.39.252" port: 36607 } } }
I20260811 01:37:05.156150 17381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 01:37:05.156785 17402 catalog_manager.cc:1504] Loading token signing keys...
I20260811 01:37:05.190035 17402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed0359508600441aa07073b9eab50362: Generated new TSK 0
I20260811 01:37:05.191339 17402 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 01:37:05.355301 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.339887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32884 (local address 127.23.39.253:35025)
0811 01:37:05.340144 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.340154 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.352475 (+ 12321us) server_negotiation.cc:407] Connection header received
0811 01:37:05.353606 (+ 1131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.353614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.353744 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.353824 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.355045 (+ 1221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32884: BlockingRecv error: recv got EOF from 127.0.0.1:32884 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 01:37:05.358073 17361 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.348613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.23.39.254:38071)
0811 01:37:05.348897 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.348904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.356160 (+ 7256us) server_negotiation.cc:407] Connection header received
0811 01:37:05.356435 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.356441 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.356537 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.356611 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.357806 (+ 1195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46480: BlockingRecv error: recv got EOF from 127.0.0.1:46480 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 01:37:05.362250 17360 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.359548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54824 (local address 127.23.39.252:36607)
0811 01:37:05.359752 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.359758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.360380 (+ 622us) server_negotiation.cc:407] Connection header received
0811 01:37:05.360625 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.360635 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.360738 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.360820 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.361893 (+ 1073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54824: BlockingRecv error: recv got EOF from 127.0.0.1:54824 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 01:37:05.409576 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.396251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32900 (local address 127.23.39.253:35025)
0811 01:37:05.396494 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.396500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.407297 (+ 10797us) server_negotiation.cc:407] Connection header received
0811 01:37:05.407892 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.407898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.408020 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.408094 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.409252 (+ 1158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32900: BlockingRecv error: recv got EOF from 127.0.0.1:32900 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 01:37:05.456351 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.446015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.23.39.253:35025)
0811 01:37:05.446226 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.446235 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.454865 (+ 8630us) server_negotiation.cc:407] Connection header received
0811 01:37:05.455115 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.455119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.455197 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.455320 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.456146 (+ 826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32906: BlockingRecv error: recv got EOF from 127.0.0.1:32906 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 01:37:05.466095 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.464091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32910 (local address 127.23.39.253:35025)
0811 01:37:05.464342 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.464349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.464629 (+ 280us) server_negotiation.cc:407] Connection header received
0811 01:37:05.464858 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.464863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.464963 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.465074 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.465860 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32910: BlockingRecv error: recv got EOF from 127.0.0.1:32910 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 01:37:05.519972 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.518039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32920 (local address 127.23.39.253:35025)
0811 01:37:05.518354 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.518361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.518384 (+ 23us) server_negotiation.cc:407] Connection header received
0811 01:37:05.518614 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.518621 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.518733 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.518797 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.519741 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32920: BlockingRecv error: recv got EOF from 127.0.0.1:32920 (error 108)
Metrics: {"server-negotiator.queue_time_us":185}
W20260811 01:37:05.534356 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.531908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32922 (local address 127.23.39.253:35025)
0811 01:37:05.532127 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.532137 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.532732 (+ 595us) server_negotiation.cc:407] Connection header received
0811 01:37:05.532976 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.532981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.533058 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.533175 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.533963 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32922: BlockingRecv error: recv got EOF from 127.0.0.1:32922 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 01:37:05.556432 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.554034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32932 (local address 127.23.39.253:35025)
0811 01:37:05.554331 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.554337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.554768 (+ 431us) server_negotiation.cc:407] Connection header received
0811 01:37:05.555003 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.555008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.555086 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.555180 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.556163 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32932: BlockingRecv error: recv got EOF from 127.0.0.1:32932 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260811 01:37:05.595678 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.593325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32944 (local address 127.23.39.253:35025)
0811 01:37:05.593575 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.593583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.593995 (+ 412us) server_negotiation.cc:407] Connection header received
0811 01:37:05.594222 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.594232 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.594348 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.594498 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.595339 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32944: BlockingRecv error: recv got EOF from 127.0.0.1:32944 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 01:37:05.665931 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.663545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.23.39.253:35025)
0811 01:37:05.663789 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.663800 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.664423 (+ 623us) server_negotiation.cc:407] Connection header received
0811 01:37:05.664669 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.664674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.664750 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.664866 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.665712 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32946: BlockingRecv error: recv got EOF from 127.0.0.1:32946 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 01:37:05.752381 17377 catalog_manager.cc:1259] Loaded cluster ID: e049cb4d3e7445d1b4620818860d40a5
I20260811 01:37:05.752554 17377 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: loading cluster ID for follower catalog manager: success
I20260811 01:37:05.755514 17377 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: acquiring CA information for follower catalog manager: success
I20260811 01:37:05.757515 17377 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 288516dae1364b3eb795855606fdfe20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 01:37:05.799862 17281 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 01:37:05.797662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32958 (local address 127.23.39.253:35025)
0811 01:37:05.797936 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:05.797943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:05.798334 (+ 391us) server_negotiation.cc:407] Connection header received
0811 01:37:05.798584 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:05.798588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:05.798665 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:05.798785 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 01:37:05.799594 (+ 809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32958: BlockingRecv error: recv got EOF from 127.0.0.1:32958 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 01:37:05.855516 17392 catalog_manager.cc:1259] Loaded cluster ID: e049cb4d3e7445d1b4620818860d40a5
I20260811 01:37:05.855620 17392 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: loading cluster ID for follower catalog manager: success
I20260811 01:37:05.858053 17392 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: acquiring CA information for follower catalog manager: success
I20260811 01:37:05.859948 17392 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8b606c3ef3a24bebbd388129403b2d0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 01:37:06.069741 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:06.063620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32968 (local address 127.23.39.253:35025)
0811 01:37:06.063855 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:06.063863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:06.064165 (+ 302us) server_negotiation.cc:407] Connection header received
0811 01:37:06.064433 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:06.064438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:06.064592 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:06.064735 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:06.065181 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.065925 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.067420 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.067850 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.067995 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:06.068536 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:06.069094 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:06.069271 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:06.069332 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 01:37:06.069423 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 01:37:06.082845 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:06.076219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54826 (local address 127.23.39.252:36607)
0811 01:37:06.076769 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:06.076774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:06.076876 (+ 102us) server_negotiation.cc:407] Connection header received
0811 01:37:06.077134 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:06.077138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:06.077439 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:06.077626 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:06.078059 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.078906 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.080262 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.080747 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.080876 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:06.081489 (+ 613us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:06.082056 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:06.082289 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:06.082392 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 01:37:06.082472 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":266,"threads_started":1}
I20260811 01:37:06.096994 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:06.090914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54830 (local address 127.23.39.252:36607)
0811 01:37:06.091095 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:06.091103 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:06.091567 (+ 464us) server_negotiation.cc:407] Connection header received
0811 01:37:06.091831 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:06.091841 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:06.091908 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:06.092005 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:06.092671 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.093393 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.095008 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.095430 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.095571 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:06.096194 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:06.096337 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:06.096425 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:06.096588 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 01:37:06.096677 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 01:37:06.098472 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:06.089446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32972 (local address 127.23.39.253:35025)
0811 01:37:06.089867 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:06.089874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:06.090692 (+ 818us) server_negotiation.cc:407] Connection header received
0811 01:37:06.091034 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:06.091040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:06.091147 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:06.091218 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:06.092258 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.093441 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.096288 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.096966 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.097125 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:06.097655 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:06.097804 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:06.097898 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:06.098054 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 01:37:06.098188 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
I20260811 01:37:06.099045 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 01:37:06.089310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46482 (local address 127.23.39.254:38071)
0811 01:37:06.089866 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 01:37:06.089873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 01:37:06.090769 (+ 896us) server_negotiation.cc:407] Connection header received
0811 01:37:06.091075 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 01:37:06.091081 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 01:37:06.091302 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 01:37:06.091460 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 01:37:06.092445 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.093511 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.096243 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 01:37:06.096923 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 01:37:06.097065 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 01:37:06.097660 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 01:37:06.098188 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 01:37:06.098291 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 01:37:06.098635 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 01:37:06.098759 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":303,"threads_started":1}
I20260811 01:37:06.105186 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 17124
I20260811 01:37:06.106393 17189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:06.221010 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 17124
I20260811 01:37:06.248584 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 17203
I20260811 01:37:06.249764 17271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:06.361657 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 17203
I20260811 01:37:06.385469 23711 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskuc9edm/build/asan/bin/kudu pid 17284
I20260811 01:37:06.386684 17352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 01:37:06.496624 23711 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuc9edm/build/asan/bin/kudu with pid 17284
2026-08-11T01:37:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5191 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10556 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (389601 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST